-- Logs begin at Fri 2022-09-09 22:31:36 UTC, end at Fri 2022-09-09 23:41:11 UTC. -- Sep 09 23:12:21.960719 dv-cinder-850321-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 23:12:21.971628 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 23:12:21.973580 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 23:12:21 2022] *** Sep 09 23:12:21.973580 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 23:12:21.973580 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 23:12:21.973580 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: nodename: dv-cinder-850321-6-iscsi Sep 09 23:12:21.973580 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: machine: x86_64 Sep 09 23:12:21.973580 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: clock source: unix Sep 09 23:12:21.973580 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: pcre jit disabled Sep 09 23:12:21.973580 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: detected number of CPU cores: 4 Sep 09 23:12:21.973580 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: current working directory: / Sep 09 23:12:21.973580 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: detected binary path: /usr/bin/uwsgi-core Sep 09 23:12:21.974285 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: your processes number limit is 47680 Sep 09 23:12:21.974285 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: your memory page size is 4096 bytes Sep 09 23:12:21.974285 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: detected max file descriptor number: 2048 Sep 09 23:12:21.974285 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: lock engine: pthread robust mutexes Sep 09 23:12:21.974285 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: thunder lock: enabled Sep 09 23:12:21.974285 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 23:12:21.974285 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 23:12:22.014330 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: Python main interpreter initialized at 0x55b586c409c0 Sep 09 23:12:22.014330 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: python threads support enabled Sep 09 23:12:22.014330 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: your server socket listen backlog is limited to 100 connections Sep 09 23:12:22.014330 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: your mercy for graceful operations on workers is 90 seconds Sep 09 23:12:22.014703 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 23:12:22.014779 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: *** Operational MODE: preforking *** Sep 09 23:12:22.015030 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: *** uWSGI is running in multiple interpreter mode *** Sep 09 23:12:22.015030 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: spawned uWSGI master process (pid: 106012) Sep 09 23:12:22.015229 dv-cinder-850321-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 23:12:22.016368 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: spawned uWSGI worker 1 (pid: 106013, cores: 1) Sep 09 23:12:22.016368 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: spawned uWSGI worker 2 (pid: 106014, cores: 1) Sep 09 23:12:22.016368 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 23:12:22.718923 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 23:12:22.750054 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 23:12:23.841371 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 23:12:23.841371 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: from cryptography.utils import int_from_bytes Sep 09 23:12:23.841993 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 23:12:23.841993 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: from cryptography.utils import int_from_bytes Sep 09 23:12:23.901631 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 23:12:23.901631 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: from cryptography.utils import int_from_bytes Sep 09 23:12:23.902272 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 23:12:23.902272 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: from cryptography.utils import int_from_bytes Sep 09 23:12:26.319540 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 23:12:26.320209 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 23:12:26.320322 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 23:12:26.320657 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 23:12:26.320742 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 23:12:26.320816 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 23:12:26.320888 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 23:12:26.320962 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 23:12:26.321174 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 23:12:26.321278 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.321428 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 23:12:26.321582 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.321815 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.321914 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.322141 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.322241 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.322499 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.323124 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.323355 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.323465 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.323686 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.323782 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.324004 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.324156 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.324324 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.324466 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.324640 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.324735 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.324966 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.325060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.325225 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.325326 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-6-iscsi {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.325540 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.325632 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.325865 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-6-iscsi {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.325958 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.326184 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.326284 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.326518 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.326622 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.326827 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.326928 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.327145 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.327244 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.327447 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.327544 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.327770 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.327960 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.328076 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.328409 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.328595 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.328709 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.328878 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.329031 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.329202 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.329340 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.329476 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.329656 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.329811 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.329963 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.330124 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.330284 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.330438 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.330626 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.330758 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.330953 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.331094 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.331266 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.331393 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.331659 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-6-iscsi {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.331774 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.331977 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.332077 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-6-iscsi {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.332288 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.332382 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.332602 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.332694 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.332948 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.333044 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.333309 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.333414 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.333618 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.333806 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.333937 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.334033 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.334256 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.334381 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.334588 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.334691 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.334900 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.335002 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.335223 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.335316 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.335545 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.335717 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.335859 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.335992 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.336135 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.336270 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.336444 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.336593 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.336753 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.336881 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.337064 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.337206 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.337355 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.337492 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.337659 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.337794 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.337937 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.338085 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.338265 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.338980 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.339155 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.339244 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.339565 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.339710 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.339889 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.339993 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.340139 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.340227 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.340389 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.340492 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.340686 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.340776 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.341261 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.341363 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.341571 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.341667 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.341876 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.341969 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.342183 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.342286 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.342514 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.342609 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.342822 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.342907 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.343126 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.343210 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.343432 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.343519 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.343736 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.343820 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.344041 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.344126 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.344362 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.344478 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.344672 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.344769 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.344978 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.345073 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.345290 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.345385 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.345612 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.345718 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.345920 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.346029 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.346228 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.346331 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.346567 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.346670 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.346897 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.347011 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.347205 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.347292 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.347511 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.347597 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.347830 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.347929 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.348136 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.348222 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.348442 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.348536 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.348745 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.348840 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.349052 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.349157 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.349385 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.349481 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.349687 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.349786 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.349935 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.350052 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.350232 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.350324 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.350560 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.350656 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.350879 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.350972 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.351185 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.351282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.351490 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.351590 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.351799 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.351897 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.352095 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.352189 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.352396 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.352488 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.352700 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.352795 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.353004 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.353097 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.353308 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.353392 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.353612 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.353703 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.353941 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.354042 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.354243 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.354438 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.354565 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.354737 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.354868 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.355051 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.355172 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.355358 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.355490 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.355663 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.355810 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.355985 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.356116 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.356308 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.356421 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.356618 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.356726 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.356925 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.357056 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.357233 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.357324 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.357542 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.357628 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.357861 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.357947 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.358170 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.358256 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.358507 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.358595 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.358834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.358922 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.359141 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.359226 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.359447 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.359535 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.359753 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.359844 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.360060 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.360152 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.360360 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.360458 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.360666 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.360752 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.360964 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.361055 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.361271 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.361370 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.361574 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.361674 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.361876 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.361975 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.362176 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.362271 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.362500 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.362588 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.362803 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.362899 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.363102 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.363196 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.363404 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.363496 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.363700 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.363785 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.364001 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.364095 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.364297 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.364391 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.364615 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.364716 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.364920 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.365012 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.365223 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.365309 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.365530 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.365626 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.365835 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.365932 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.366152 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:12:26.366239 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.366510 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.366610 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.366839 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.366925 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.367172 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.367258 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.367486 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.367583 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.367810 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.367902 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.368122 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.368254 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.368438 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.368538 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.368751 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.368857 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.369061 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.369146 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.369368 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.369480 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.369706 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.369847 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.370107 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.370192 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.370460 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.370578 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.370797 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.370893 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.371115 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.371210 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.371432 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.371527 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.371751 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.371836 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.372062 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.372167 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.372380 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.372476 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.372689 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.372775 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.373010 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.373107 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.373316 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.373403 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.373651 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.373743 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.373963 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.374051 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.374297 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.374397 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.374647 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.374780 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.374969 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.375070 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.375281 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.375369 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.375590 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.375684 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.375901 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.375988 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.376211 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.376297 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.376522 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.376610 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.376841 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.376934 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.377160 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.377254 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.377471 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.377563 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.377791 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.377885 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.378101 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.378193 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.378440 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.378532 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.378755 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.378853 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.379064 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.379158 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.379373 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.379459 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.379685 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.379779 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.379997 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.380083 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.380318 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.380403 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.380632 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.380718 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.380942 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.381027 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.381258 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.381343 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.381568 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.381661 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.381880 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.381975 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.382194 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.382291 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.382517 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.382604 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.382821 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.382908 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.383124 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.383216 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.383427 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.383515 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.383728 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.383812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.384035 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.384119 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.384339 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.384433 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.384656 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.384750 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.384981 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.385598 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.385850 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.385946 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.386247 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.386335 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.386585 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.386691 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.386897 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.386984 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.387202 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.387289 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.387516 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.387611 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.387826 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.387923 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.388129 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.388216 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.388441 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.388539 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.388749 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.388834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.389053 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.389148 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.389372 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.389466 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.389676 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.389769 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.389981 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.390067 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.390289 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.390395 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.390621 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.390716 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.390931 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.391018 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.391241 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.391380 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.391549 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.391635 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.391862 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.391955 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.392187 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.392315 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.392480 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.392573 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.392800 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.392904 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.393114 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.393208 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.393418 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.393512 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.393744 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.393839 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.394058 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.394143 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.394394 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.394483 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.394705 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.394848 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.395015 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.395119 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.395316 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.395403 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.395615 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.395714 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.395919 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.396013 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.396226 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.396312 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.396525 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.396623 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.396826 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.396913 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.397125 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.397211 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.397425 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.397565 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.397724 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.397863 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.398046 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.398178 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.398363 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.398506 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.398674 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.398808 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.398975 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.399119 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.399266 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.399400 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.399562 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.399698 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.399864 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.400056 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.400230 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.400365 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.400498 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.400632 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.401404 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.401566 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.401746 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.401941 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.402081 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.402217 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.402382 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.402532 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.402687 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.402820 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.402981 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.403115 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.403293 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.403449 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.403605 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.403747 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.403926 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.404057 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.404237 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.404374 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.404553 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.404689 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.404867 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.405011 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.405190 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.405331 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.405501 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.405635 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.405819 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.405952 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.406123 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.406256 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.406460 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.406605 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.406764 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.406898 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.407080 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.407217 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.407420 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.407565 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.407741 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.407876 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.408053 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.408190 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.408367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.408503 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.408676 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.408821 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.408988 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.409122 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.409298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.409443 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.409592 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.409751 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.409905 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.409992 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.410213 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.410297 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.410806 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.410912 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.410912 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.411040 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.411170 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.411246 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.411508 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.411604 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.411794 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.411869 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.412096 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.412177 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.412469 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.412556 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.412718 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.412792 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.413031 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.413105 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.415536 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.415656 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.415734 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.415803 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.415877 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.415944 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.416018 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.416091 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.416157 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.416228 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.416297 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.416407 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.416494 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.416584 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.416718 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.416811 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.416885 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.416963 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.417029 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.417093 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.417156 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.417220 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.417220 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.417342 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.417929 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.418024 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.418116 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.418197 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.418285 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.418381 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.418463 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.418553 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.418641 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.418728 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.418816 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.418895 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.418973 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.419053 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.419131 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.419209 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.419381 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.419477 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.419691 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.419786 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.420012 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.420108 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.420332 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.420458 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.420634 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.420722 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.420936 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.421033 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.421247 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.421334 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.421564 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.421697 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.421850 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.421950 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.422153 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.422241 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.422477 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.422632 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.422798 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.422898 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.423112 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.423209 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.423413 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.423499 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.423723 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.423810 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.424040 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.424126 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.424347 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.424433 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.424657 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.424745 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.424963 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.425049 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.425271 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.425358 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.425575 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.425678 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.425888 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.425981 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.426193 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.426279 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.426525 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.426614 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.426835 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.426923 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.427146 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.427241 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.427451 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.427577 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.427760 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.427847 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.428066 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.428161 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.428368 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.428455 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.428675 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.428760 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.428979 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.429144 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.429288 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.429550 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.429638 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.429883 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.430155 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.430253 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.430512 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.430602 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.430829 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.430918 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.431147 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.431243 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.431489 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.431584 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.431808 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.431902 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.432188 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.432291 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.432507 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.432740 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.432831 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.432913 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.433100 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.433188 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.433403 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.433504 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.433712 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.433808 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.434016 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.434111 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.434318 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.434464 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.434646 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.434769 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.434947 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.435046 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.435247 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.435331 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.435549 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.435631 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.435851 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.435926 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.436150 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.436233 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.436452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.436527 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.436759 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.436896 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.437071 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.437176 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.437372 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.437473 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.437683 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.437797 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.437984 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.438063 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.438293 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.438385 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.438623 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.438729 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.438926 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.439008 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.439229 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.439325 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.440405 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.440520 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.440613 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.440702 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.440783 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.440863 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.440942 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.441031 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.441120 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.441201 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.441201 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.441355 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.441444 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.441525 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.441702 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.441861 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.441999 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.442134 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.442279 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.442391 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.442606 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.442697 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.442914 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.442992 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.443214 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.443293 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.443533 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.443643 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.443834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.443922 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.444146 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.444242 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.444457 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.444551 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.444767 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.444868 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.445074 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.445167 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.445375 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.445461 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.448160 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.448468 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.448573 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.448716 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.448716 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.448918 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.449011 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.449108 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.449108 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.449327 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.449452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.449536 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.449536 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.449696 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.449696 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.449959 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.450098 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.450228 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.450392 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.450528 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.450651 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.450780 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.450903 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.451026 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.451167 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.451293 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.451425 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.451548 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.451670 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.451806 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.452002 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.452130 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.452253 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.452375 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.452507 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.452634 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.452769 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.452894 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.453018 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.453140 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.453263 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.453397 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.453531 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.453740 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.453861 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.453992 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.454090 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.454253 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.454358 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.454457 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.454540 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.454619 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.454698 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.454786 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.454866 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.454945 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.455035 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.455149 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.455244 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.455333 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.455413 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.455491 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.455575 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.455662 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.455750 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.455837 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.455996 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.456117 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.456298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.456424 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.456600 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.456725 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.456900 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.457030 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.457199 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.457296 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.457499 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.457587 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.457823 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.457919 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.458136 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.458243 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.458461 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.458553 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.458767 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.458854 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.459070 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.459171 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.459415 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.459541 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.459719 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.459844 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.460032 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.460202 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.460349 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.460436 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.460662 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.460749 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.460977 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.461073 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.461286 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.461375 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.461604 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.461692 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.461897 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.461992 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.462206 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.462371 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.462536 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.462659 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.462841 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.462990 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.463147 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.463324 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.464077 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.464257 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.464436 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.464551 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.464687 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.464777 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.465006 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.465094 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.465334 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.465423 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.465653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.465740 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.466208 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.466298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.466543 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.466633 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.466855 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.466944 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.467161 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.467246 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.467468 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.467555 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.467773 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.467862 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.468081 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.468179 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.468382 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.468483 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.468687 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.468790 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.468992 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.469088 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.469301 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.469396 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.469602 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.469695 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.469909 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.470005 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.470215 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.470313 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.470540 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.470648 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.470843 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.470944 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.471145 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.471290 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.471467 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.471565 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.471775 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.471870 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.472077 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.472187 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.472384 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.472487 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.472680 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.472774 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.472986 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.473111 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.473292 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.473422 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.473724 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.473813 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.474030 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.474182 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.474333 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.474472 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.474650 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.474740 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.474961 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.475049 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.475270 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.475367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.475571 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.475666 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.475888 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.475974 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.476190 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.476294 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.476581 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.476675 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.476891 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.476985 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.477194 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.477290 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.477495 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.477590 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.477796 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.477883 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.478100 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.478195 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.478426 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.478529 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.478730 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.478860 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.479058 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.479153 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.479356 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.479441 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.479670 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.479843 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.479988 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.480174 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.480405 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.480509 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.480715 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.480802 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.481018 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.481193 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.481431 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.481518 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.481741 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.481840 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.482048 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.482197 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.482384 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.482542 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.482710 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.482832 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.483034 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.483160 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.483338 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.483485 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.483649 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.483811 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.483956 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.484118 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.484278 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.484430 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.484602 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.484738 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.484914 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.485062 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.485234 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.485388 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.485537 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.485700 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.485860 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.486013 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.486184 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.486318 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.486528 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.486664 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.486852 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.486987 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.487267 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.487363 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.487593 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.487680 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.487904 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.487992 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.488227 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.488323 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.488551 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.488638 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.488856 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.488945 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.489159 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.489247 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.489468 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.489555 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.489771 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.489867 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.490071 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.490167 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.490417 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.490511 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.490722 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.490810 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.491031 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.491117 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.491335 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.491436 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.491642 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.491736 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.491945 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.492032 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.492247 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.492347 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.492548 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.492634 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.492851 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.492938 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.493171 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.493306 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.493473 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.493560 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.493791 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.493877 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.494100 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.494198 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.494423 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.494541 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.494769 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.494989 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.495089 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.495302 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.495475 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.495626 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.495783 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.495938 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.496087 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.496244 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.496430 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.496531 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.496736 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.496829 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.497055 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.497167 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.497383 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.497469 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.497712 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.497801 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.498021 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.498109 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.498380 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.498472 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.498700 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.498801 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.499020 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.499107 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.499328 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.499413 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.499641 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.499738 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.499963 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.500051 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.500265 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.500360 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.500566 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.500729 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.500874 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.500962 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.501175 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.501260 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.501474 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.501561 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.501774 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.501860 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.502074 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.502159 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.502391 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.502492 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.502698 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.502792 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.502996 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.503081 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.503304 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.503392 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.503604 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.503689 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.503924 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.504011 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.504226 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.504321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.504526 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.504629 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.504825 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.504922 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.505130 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.505217 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.505429 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.505514 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.505732 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.505827 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.506071 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.506165 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.506392 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.506482 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.506719 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.506818 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.507025 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.507111 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.507337 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.507423 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.507650 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.507807 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.507963 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.508048 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.508277 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.508365 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.508589 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.508675 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.508902 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.508994 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.509209 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.509295 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.509521 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.509608 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.509828 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.509963 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.510676 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.510774 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.511082 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.511328 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.511418 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.511669 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.511920 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.512008 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.512248 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.512336 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.512561 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.512656 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.512873 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.512963 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.513184 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.513266 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.513500 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.513597 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.513810 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.513904 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.514118 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.514205 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.514452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.514544 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.514766 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.514862 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.515073 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.515169 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.515401 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.515488 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.515722 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.515811 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.516044 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.516129 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.516362 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.516448 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.516677 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.516765 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.516989 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.517082 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.517300 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.517387 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.517613 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.517703 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.517942 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.518027 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.518257 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.518368 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.518586 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.518684 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.518900 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.518985 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.519211 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.519310 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.519521 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.519606 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.519829 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.519915 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.520140 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.520228 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.520449 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.520542 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.520761 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.520856 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.521063 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.521158 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.521370 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.521465 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.521682 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.521769 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.521993 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.522089 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.522323 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.522440 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.522669 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.522774 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.522983 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.523070 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.523297 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.523383 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.523616 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.523814 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.523929 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.524128 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.524444 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.524533 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.524759 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.524868 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.525087 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.525175 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.525408 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.525501 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.525790 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.526484 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.526648 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.526749 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.526957 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.527045 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.527263 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.527351 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.527576 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.527670 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.527885 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.527980 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.528188 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.528277 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.528508 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.528595 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.528810 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.528896 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.529113 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.529201 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.529426 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.529511 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.529728 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.529824 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.530045 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.530256 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.530373 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.530628 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.530899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.531048 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.531248 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.531335 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.531563 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.531649 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.531875 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.531970 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.532182 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.532271 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.532500 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.532585 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.532805 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.532904 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.533111 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.533198 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.533417 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.533513 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.533722 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.533810 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.534023 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.534116 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.534326 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.534434 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.534654 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.534743 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.534959 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.535046 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.535262 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.535347 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.535569 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.535656 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.535871 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.535958 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.536178 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.536265 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.536483 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.536585 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.536783 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.536869 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.537085 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.537181 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.537392 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.537478 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.537694 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.537780 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.537998 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.538161 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.538300 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.538483 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.538626 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.538713 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.538929 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.539028 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.539229 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.539315 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.539536 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.539625 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.539836 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.539931 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.540142 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.540229 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.540443 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.540530 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.540753 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.540842 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.541082 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.541175 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.541429 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.541570 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.541711 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.541800 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.542017 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.542103 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.542334 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.542440 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.542667 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.542764 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.542991 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.543090 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.543300 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.543398 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.543611 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.543707 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.543936 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.544023 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.544256 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.544352 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.544600 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.544789 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.544915 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.545125 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.545450 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.545546 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.545780 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.545867 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.546104 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.546191 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.546439 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.546575 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.546747 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.546859 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.547052 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.547151 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.547374 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.547481 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.547682 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.547778 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.547993 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.548089 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.548304 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.548401 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.548614 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.548711 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.548922 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.549020 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.549229 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.549328 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.549540 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.549637 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.549847 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.549944 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.550155 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.550259 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.550486 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.550583 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.550796 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.550902 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.551102 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.551206 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.551411 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.551513 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.551718 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.551823 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.552028 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.552123 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.552339 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.552435 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.552654 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.552763 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.552978 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.553073 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.553296 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.553402 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.553615 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.553705 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.553924 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.554012 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.554232 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.554328 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.554567 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.554657 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.554875 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.554962 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.555185 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.555271 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.555493 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.555581 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.555808 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.555895 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.556111 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.556204 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.556441 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.556746 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.556841 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.557634 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.557959 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.558056 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.558286 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.558405 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.558624 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.558712 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.558952 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.559048 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.559279 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.559374 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.559594 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.559683 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.559915 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.560010 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.560226 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.560313 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.560545 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.560645 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.560859 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.560947 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.561194 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.561308 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.561519 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.561616 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.561826 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.561933 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.562130 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.562226 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.562457 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.562555 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.562766 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.562857 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.563069 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.563156 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.563382 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.563542 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.563683 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.563819 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.563954 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.564089 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.564264 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.564412 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.564569 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.564713 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.564871 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.565018 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.565174 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.565314 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.565477 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.565614 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.565780 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.565917 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.566080 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.566225 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.566401 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.566493 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.566705 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.566793 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.567006 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.567094 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.567304 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.567390 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.567603 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.567690 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.567904 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.567994 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.568205 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.568292 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.568520 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.568623 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.568805 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.568893 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.569105 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.569191 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.569405 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.569494 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.569752 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.569854 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.570009 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.570106 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.570366 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.570469 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.570688 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.570775 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.570999 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.571087 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.571321 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.571434 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.571625 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.571713 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.571945 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.572039 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.572253 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.572348 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.572582 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.572787 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.572925 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.573014 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.573244 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.573400 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.573577 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.573674 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.573854 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.573942 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.574167 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.574256 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.574510 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.574652 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.574824 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.575103 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.575231 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.575429 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.575740 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.576068 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.576396 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.576581 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.576702 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.576925 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.577013 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.577258 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.577347 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.577571 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.577660 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.577902 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.577989 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.578223 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.578320 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.578574 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.578671 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.578884 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.578971 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.579196 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.579281 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.579503 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.579592 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.579813 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.579901 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.580125 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.580220 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.580432 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.580519 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.580738 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.580825 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.581047 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.581142 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.581366 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.581483 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.581680 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.581790 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.581992 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.582102 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.582311 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.582444 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.582642 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.582738 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.582967 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.583056 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.583292 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.583378 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.583601 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.583750 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.583927 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.584066 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.584255 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.584391 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.584588 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.584725 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.584903 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.585040 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.585216 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.585359 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.585522 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.585658 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.585802 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 23:12:26.585936 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.586166 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.586497 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:12:26.586739 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 23:12:26.741031 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO dbcounter [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] Registered counter for database nova_api Sep 09 23:12:26.741334 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO dbcounter [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Registered counter for database nova_api Sep 09 23:12:26.763183 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG oslo_db.sqlalchemy.engines [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106013) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:12:26.765740 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_db.sqlalchemy.engines [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:12:26.770022 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG dbcounter [-] [106013] Writer thread running {{(pid=106013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:12:26.772206 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writer thread running {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:12:26.827763 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.context [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c(cell1) {{(pid=106013) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 23:12:26.828544 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.context [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c(cell1) {{(pid=106014) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 23:12:26.831761 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG oslo_concurrency.lockutils [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:26.832227 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG oslo_concurrency.lockutils [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:26.832543 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:26.833020 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:26.833762 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG oslo_concurrency.lockutils [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:26.834505 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG oslo_concurrency.lockutils [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:26.834601 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:26.834946 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG oslo_concurrency.lockutils [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:26.835315 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:12:26.835752 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:12:26.836901 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG oslo_concurrency.lockutils [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:26.837710 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:12:26.839015 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO dbcounter [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] Registered counter for database nova_cell0 Sep 09 23:12:26.839948 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO dbcounter [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Registered counter for database nova_cell0 Sep 09 23:12:26.843253 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO dbcounter [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] Registered counter for database nova_cell1 Sep 09 23:12:26.844116 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO dbcounter [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Registered counter for database nova_cell1 Sep 09 23:12:26.850441 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG oslo_db.sqlalchemy.engines [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106013) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:12:26.852048 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG oslo_db.sqlalchemy.engines [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106013) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:12:26.853777 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_db.sqlalchemy.engines [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:12:26.856483 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_db.sqlalchemy.engines [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:12:26.857597 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG dbcounter [-] [106013] Writer thread running {{(pid=106013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:12:26.860255 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG dbcounter [-] [106013] Writer thread running {{(pid=106013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:12:26.860666 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writer thread running {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:12:26.997922 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writer thread running {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:12:27.002520 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO dbcounter [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] Registered counter for database nova_cell0 Sep 09 23:12:27.007939 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO dbcounter [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Registered counter for database nova_cell0 Sep 09 23:12:27.009260 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG oslo_db.sqlalchemy.engines [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106013) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:12:27.014951 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG dbcounter [-] [106013] Writer thread running {{(pid=106013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:12:27.017278 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_db.sqlalchemy.engines [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:12:27.022096 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writer thread running {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:12:27.410311 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: WARNING keystonemiddleware.auth_token [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 23:12:27.412896 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: WARNING keystonemiddleware.auth_token [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 23:12:27.418636 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: WARNING keystonemiddleware.auth_token [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 23:12:27.420169 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: WARNING keystonemiddleware.auth_token [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 23:12:27.764143 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: WARNING keystonemiddleware.auth_token [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 23:12:27.770048 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: WARNING keystonemiddleware.auth_token [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 23:12:27.773093 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: WARNING keystonemiddleware.auth_token [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 23:12:27.775667 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b586c409c0 pid: 106014 (default app) Sep 09 23:12:27.777962 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:12:27.779175 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001857 Sep 09 23:12:27.779583 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Fri Sep 9 23:12:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:12:27.779894 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: WARNING keystonemiddleware.auth_token [None req-f191c390-0706-4c50-92be-677d433bbf8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 23:12:27.785340 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b586c409c0 pid: 106013 (default app) Sep 09 23:13:53.304929 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:53.305948 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 09 23:13:53.306626 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 23:13:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:13:53.318773 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG dbcounter [-] [106013] Writing DB stats nova_api:SELECT=3 {{(pid=106013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:53.320014 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG dbcounter [-] [106013] Writing DB stats nova_cell0:SELECT=3 {{(pid=106013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:53.320714 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG dbcounter [-] [106013] Writing DB stats nova_cell1:SELECT=3 {{(pid=106013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:53.321603 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG dbcounter [-] [106013] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:54.212026 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-ec0ef24c-ae36-45a0-9782-2ac6c54356ef admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:54.249753 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-ec0ef24c-ae36-45a0-9782-2ac6c54356ef admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.935975 Sep 09 23:13:54.250570 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Sep 9 23:13:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:13:56.923466 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:13:56.924457 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-3692bfaa-9060-4aec-99df-52f89b20fcd8 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Sep 09 23:13:56.924841 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 23:13:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:13:57.390944 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-9b71cdbd-1232-4272-829f-0198c208b816 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "swap": 0, "id": "c1"}} {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:13:57.492099 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-9b71cdbd-1232-4272-829f-0198c208b816 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.560946 Sep 09 23:13:57.492673 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 23:13:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:13:57.506333 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_api:SELECT=3 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:57.507161 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_cell1:SELECT=3 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:57.508138 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_cell0:SELECT=3 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:57.508873 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:13:57.719871 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-dec30b12-6417-48cb-9919-7ae7f04e5672 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:13:57.856263 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-dec30b12-6417-48cb-9919-7ae7f04e5672 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.355061 Sep 09 23:13:57.856847 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Sep 9 23:13:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:14:00.498201 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-9b71cdbd-1232-4272-829f-0198c208b816 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:00.499259 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-9b71cdbd-1232-4272-829f-0198c208b816 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Sep 09 23:14:00.499672 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 23:14:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:01.172043 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-a2e3f08a-b289-43ee-b3b3-e423bf9cb1c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 512, "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:01.311525 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-a2e3f08a-b289-43ee-b3b3-e423bf9cb1c7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.798274 Sep 09 23:14:01.311525 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 23:14:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:14:01.317648 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-c0dfdd0f-cf89-4599-b49c-8d8369233475 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:01.433902 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-c0dfdd0f-cf89-4599-b49c-8d8369233475 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120018 Sep 09 23:14:01.434735 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Sep 9 23:14:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:14:04.065868 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-a2e3f08a-b289-43ee-b3b3-e423bf9cb1c7 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:04.067066 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-a2e3f08a-b289-43ee-b3b3-e423bf9cb1c7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001665 Sep 09 23:14:04.067473 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 23:14:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:04.501420 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-0509cd9e-39f0-4e01-a8c8-a1cfc467de55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "disk": 10, "name": "ds1G", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:04.573979 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-0509cd9e-39f0-4e01-a8c8-a1cfc467de55 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.499738 Sep 09 23:14:04.574804 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 23:14:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:14:04.587971 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-2499cd51-c0e6-40ea-be11-f83c760115cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:04.704467 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-2499cd51-c0e6-40ea-be11-f83c760115cf admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.121592 Sep 09 23:14:04.705043 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Sep 9 23:14:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:14:07.317974 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-0509cd9e-39f0-4e01-a8c8-a1cfc467de55 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:07.319016 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-0509cd9e-39f0-4e01-a8c8-a1cfc467de55 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 09 23:14:07.319414 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 23:14:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:07.747921 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-ecbc0278-8649-460f-9899-682c33dfe336 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:07.831605 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-ecbc0278-8649-460f-9899-682c33dfe336 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506010 Sep 09 23:14:07.832255 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 23:14:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 23:14:07.846195 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-b604ead6-fb9a-4a81-a2a8-b9600bb00f43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:07.932915 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-b604ead6-fb9a-4a81-a2a8-b9600bb00f43 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090572 Sep 09 23:14:07.946375 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Sep 9 23:14:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:14:10.654528 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-ecbc0278-8649-460f-9899-682c33dfe336 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:10.656174 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-ecbc0278-8649-460f-9899-682c33dfe336 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002127 Sep 09 23:14:10.656580 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 23:14:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:11.060435 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-f1856981-73fe-43d9-8407-44521afba134 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "disk": 20, "id": "d4", "ram": 4096}} {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:11.128855 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-f1856981-73fe-43d9-8407-44521afba134 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.465915 Sep 09 23:14:11.129414 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 23:14:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:14:11.141645 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-e7080d68-a138-45f9-b94e-7fe2359c595d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:11.235917 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-e7080d68-a138-45f9-b94e-7fe2359c595d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097761 Sep 09 23:14:11.236675 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Sep 9 23:14:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:14:14.218969 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-f1856981-73fe-43d9-8407-44521afba134 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:14.219997 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-f1856981-73fe-43d9-8407-44521afba134 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001819 Sep 09 23:14:14.220407 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 23:14:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:14.660767 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-97e43f7c-3cbc-4c48-a41e-3897ea9c0d7f admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:14.686538 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-97e43f7c-3cbc-4c48-a41e-3897ea9c0d7f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.459934 Sep 09 23:14:14.687099 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Sep 9 23:14:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:14:17.469203 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-f1856981-73fe-43d9-8407-44521afba134 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:17.470223 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-f1856981-73fe-43d9-8407-44521afba134 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 09 23:14:17.470675 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 23:14:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:17.897271 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-72d4307d-b28c-4680-8088-ea376e9077b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "ram": 512, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:17.965995 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-72d4307d-b28c-4680-8088-ea376e9077b3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.488610 Sep 09 23:14:17.966673 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 23:14:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:14:17.978942 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-cd79a7e8-edaf-425c-8db2-175ddf6a6216 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:18.082901 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-cd79a7e8-edaf-425c-8db2-175ddf6a6216 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107602 Sep 09 23:14:18.086689 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Sep 9 23:14:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:14:20.772709 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-72d4307d-b28c-4680-8088-ea376e9077b3 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:20.773744 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-72d4307d-b28c-4680-8088-ea376e9077b3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 09 23:14:20.774172 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 23:14:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:21.225597 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-9da56daf-86f3-4bed-a98c-c786f8c60179 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "disk": 20, "id": "2"}} {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:22.031205 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-9da56daf-86f3-4bed-a98c-c786f8c60179 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.250419 Sep 09 23:14:22.031931 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 23:14:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:14:22.044170 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-5dd1ae12-d7e3-468c-8976-f8a73c8d5e6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:22.151941 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-5dd1ae12-d7e3-468c-8976-f8a73c8d5e6e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111521 Sep 09 23:14:22.152660 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Sep 9 23:14:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:14:24.848680 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-9da56daf-86f3-4bed-a98c-c786f8c60179 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:24.849684 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-9da56daf-86f3-4bed-a98c-c786f8c60179 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 09 23:14:24.850399 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 23:14:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:25.301370 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-583edc83-0142-4ab5-beac-89c7540bf332 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "disk": 40}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:25.381760 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-583edc83-0142-4ab5-beac-89c7540bf332 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.524578 Sep 09 23:14:25.382620 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 23:14:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 23:14:25.396482 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-f10ca046-9bac-4f23-bdf6-e638e91d7594 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:25.401772 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG dbcounter [-] [106013] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:14:25.490269 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-f10ca046-9bac-4f23-bdf6-e638e91d7594 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099003 Sep 09 23:14:25.491062 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Sep 9 23:14:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:14:28.237847 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-583edc83-0142-4ab5-beac-89c7540bf332 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:28.237847 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-583edc83-0142-4ab5-beac-89c7540bf332 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Sep 09 23:14:28.237847 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 23:14:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:28.722581 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-c5c55cd3-0579-4fa4-972d-8372b5182f22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "disk": 80, "swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:28.792120 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-c5c55cd3-0579-4fa4-972d-8372b5182f22 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.547717 Sep 09 23:14:28.792684 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 23:14:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:14:28.804617 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-0d2ed250-6bdc-4ab5-a6ac-003ed6207662 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:28.889564 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-0d2ed250-6bdc-4ab5-a6ac-003ed6207662 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088459 Sep 09 23:14:28.890657 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Sep 9 23:14:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:14:31.575954 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-c5c55cd3-0579-4fa4-972d-8372b5182f22 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:31.576986 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-c5c55cd3-0579-4fa4-972d-8372b5182f22 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 09 23:14:31.577578 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 23:14:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:32.052956 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-6806b5fb-62e0-4e56-ad3f-863422c2fe95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "ram": 16384}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:32.064236 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:14:32.519985 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-6806b5fb-62e0-4e56-ad3f-863422c2fe95 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.936472 Sep 09 23:14:32.520544 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 23:14:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 23:14:32.533009 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-248f9700-cde6-4d82-90e1-c88bc173c0bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:32.608944 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-248f9700-cde6-4d82-90e1-c88bc173c0bb admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079711 Sep 09 23:14:32.613534 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Sep 9 23:14:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:14:47.806274 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-6806b5fb-62e0-4e56-ad3f-863422c2fe95 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:47.808002 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-6806b5fb-62e0-4e56-ad3f-863422c2fe95 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002106 Sep 09 23:14:47.808400 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 23:14:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:47.818928 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG dbcounter [-] [106013] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:14:48.204528 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-1cdbce59-5323-41d6-9983-041d5e99dfc8 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:48.223836 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-1cdbce59-5323-41d6-9983-041d5e99dfc8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409347 Sep 09 23:14:48.224373 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Sep 9 23:14:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:14:49.572819 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-6806b5fb-62e0-4e56-ad3f-863422c2fe95 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:49.573826 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-6806b5fb-62e0-4e56-ad3f-863422c2fe95 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002109 Sep 09 23:14:49.574219 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 23:14:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:50.104150 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-28c93a14-380a-48c4-ba94-71be0376d1f4 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:50.111285 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.wsgi [None req-28c93a14-380a-48c4-ba94-71be0376d1f4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-28c93a14-380a-48c4-ba94-71be0376d1f4 admin admin] Request method failure captured: Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Accept: application/json Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Accept-Encoding: gzip, deflate Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Connection: keep-alive Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Content-Length: 0 Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Host: 10.222.0.20 Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Openstack-Api-Version: compute 2.92 Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Openstack-System-Scope: None Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: User-Agent: python-novaclient Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Auth-Token: gAAAAABjG8jp1EG28l5FdZub6fI6f4TSEss5Oy5z7KI4DajlMeMgXvUDL_NZeQ4RZHU9jWng00NxKBCa7yL4I-d5K0czXVm6Tjti-rZYU88YWyPy9rMRnOWHe9TgpCdmxvHDOAJES3NCVJIQ6X1-JuAc952tpETGIOKgsNyoCXST0Jb9Gpjl2AA Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Domain-Id: None Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Domain-Name: None Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Identity-Status: Confirmed Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Is-Admin-Project: True Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Project-Domain-Id: default Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Project-Domain-Name: Default Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Project-Id: 7393fe084b62454e9d96e9d57737a145 Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Project-Name: admin Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Role: reader,admin,member Sep 09 23:14:50.114653 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Roles: reader,admin,member Sep 09 23:14:50.116298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7393fe084b62454e9d96e9d57737a145", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:14:50.116298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Tenant: admin Sep 09 23:14:50.116298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Tenant-Id: 7393fe084b62454e9d96e9d57737a145 Sep 09 23:14:50.116298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Tenant-Name: admin Sep 09 23:14:50.116298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-User: admin Sep 09 23:14:50.116298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-User-Domain-Id: default Sep 09 23:14:50.116298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-User-Domain-Name: Default Sep 09 23:14:50.116298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-User-Id: e84ee63259eb48d0a32d4ab69da0f378 Sep 09 23:14:50.116298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-User-Name: admin Sep 09 23:14:50.116298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: method: > Sep 09 23:14:50.116298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: exception: Flavor 42 could not be found. Sep 09 23:14:50.116298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: action_args: {'id': '42'} Sep 09 23:14:50.116298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:14:50.116298 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:50.117343 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Sep 09 23:14:50.118812 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-28c93a14-380a-48c4-ba94-71be0376d1f4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:14:50.120306 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-28c93a14-380a-48c4-ba94-71be0376d1f4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.399127 Sep 09 23:14:50.120306 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Sep 9 23:14:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 23:14:50.126428 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-0d03af2f-eb9d-49b9-b76b-e15b67551e7d admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:50.148713 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-0d03af2f-eb9d-49b9-b76b-e15b67551e7d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026243 Sep 09 23:14:50.149269 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Sep 9 23:14:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:14:50.160757 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-57d733dc-f472-4fae-9967-3911003fe053 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:50.182771 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-57d733dc-f472-4fae-9967-3911003fe053 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026709 Sep 09 23:14:50.183308 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Sep 9 23:14:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:14:50.192914 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-1e292d3c-40d2-458a-b7a2-9327e875774c admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:50.199299 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.wsgi [None req-1e292d3c-40d2-458a-b7a2-9327e875774c admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-1e292d3c-40d2-458a-b7a2-9327e875774c admin admin] Request method failure captured: Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Accept: application/json Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Accept-Encoding: gzip, deflate Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Connection: keep-alive Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Content-Length: 0 Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Host: 10.222.0.20 Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Openstack-Api-Version: compute 2.92 Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Openstack-System-Scope: None Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: User-Agent: python-novaclient Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Auth-Token: gAAAAABjG8jp1EG28l5FdZub6fI6f4TSEss5Oy5z7KI4DajlMeMgXvUDL_NZeQ4RZHU9jWng00NxKBCa7yL4I-d5K0czXVm6Tjti-rZYU88YWyPy9rMRnOWHe9TgpCdmxvHDOAJES3NCVJIQ6X1-JuAc952tpETGIOKgsNyoCXST0Jb9Gpjl2AA Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Domain-Id: None Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Domain-Name: None Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Identity-Status: Confirmed Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Is-Admin-Project: True Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Project-Domain-Id: default Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Project-Domain-Name: Default Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Project-Id: 7393fe084b62454e9d96e9d57737a145 Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Project-Name: admin Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Role: reader,admin,member Sep 09 23:14:50.203132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Roles: reader,admin,member Sep 09 23:14:50.213412 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7393fe084b62454e9d96e9d57737a145", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:14:50.213412 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Tenant: admin Sep 09 23:14:50.213412 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Tenant-Id: 7393fe084b62454e9d96e9d57737a145 Sep 09 23:14:50.213412 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Tenant-Name: admin Sep 09 23:14:50.213412 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-User: admin Sep 09 23:14:50.213412 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-User-Domain-Id: default Sep 09 23:14:50.213412 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-User-Domain-Name: Default Sep 09 23:14:50.213412 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-User-Id: e84ee63259eb48d0a32d4ab69da0f378 Sep 09 23:14:50.213412 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-User-Name: admin Sep 09 23:14:50.213412 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: method: > Sep 09 23:14:50.213412 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: exception: Flavor 42 could not be found. Sep 09 23:14:50.213412 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: action_args: {'id': '42'} Sep 09 23:14:50.213412 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:14:50.213412 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:50.214307 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 09 23:14:50.215609 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-1e292d3c-40d2-458a-b7a2-9327e875774c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:14:50.216804 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-1e292d3c-40d2-458a-b7a2-9327e875774c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015323 Sep 09 23:14:50.216804 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Sep 9 23:14:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 23:14:51.443034 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-57d733dc-f472-4fae-9967-3911003fe053 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:51.444069 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-57d733dc-f472-4fae-9967-3911003fe053 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 09 23:14:51.444461 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 23:14:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:51.961718 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-c98c8843-f0f5-4149-a775-48afc5e5fcc6 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:51.967356 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.wsgi [None req-c98c8843-f0f5-4149-a775-48afc5e5fcc6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-c98c8843-f0f5-4149-a775-48afc5e5fcc6 admin admin] Request method failure captured: Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Accept: application/json Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Accept-Encoding: gzip, deflate Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Connection: keep-alive Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Content-Length: 0 Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Host: 10.222.0.20 Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Openstack-Api-Version: compute 2.92 Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Openstack-System-Scope: None Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: User-Agent: python-novaclient Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Auth-Token: gAAAAABjG8jrnXLQG58j17BUU1DCmGyPvxicnuLFAOyUH-2eIxzVDeRUFwtMcEgC9-ck2pI2kYutbBjQMb_CGSOeBsHHN_2Hbbv26lmZWfQysobSifuQjPTohob9imc74r4v814mq-tHlRSjx46iKfW1_Eql1ebgSK3kMq2x0PCPiZ-hfMj6x0o Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Domain-Id: None Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Domain-Name: None Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Identity-Status: Confirmed Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Is-Admin-Project: True Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Project-Domain-Id: default Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Project-Domain-Name: Default Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Project-Id: 7393fe084b62454e9d96e9d57737a145 Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Project-Name: admin Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Role: reader,admin,member Sep 09 23:14:51.969133 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Roles: reader,admin,member Sep 09 23:14:51.970577 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7393fe084b62454e9d96e9d57737a145", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:14:51.970577 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Tenant: admin Sep 09 23:14:51.970577 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Tenant-Id: 7393fe084b62454e9d96e9d57737a145 Sep 09 23:14:51.970577 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Tenant-Name: admin Sep 09 23:14:51.970577 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-User: admin Sep 09 23:14:51.970577 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-User-Domain-Id: default Sep 09 23:14:51.970577 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-User-Domain-Name: Default Sep 09 23:14:51.970577 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-User-Id: e84ee63259eb48d0a32d4ab69da0f378 Sep 09 23:14:51.970577 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-User-Name: admin Sep 09 23:14:51.970577 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: method: > Sep 09 23:14:51.970577 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: exception: Flavor 84 could not be found. Sep 09 23:14:51.970577 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: action_args: {'id': '84'} Sep 09 23:14:51.970577 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:14:51.970577 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:51.971367 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 09 23:14:51.972612 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-c98c8843-f0f5-4149-a775-48afc5e5fcc6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:14:51.973825 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-c98c8843-f0f5-4149-a775-48afc5e5fcc6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.390537 Sep 09 23:14:51.973825 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Sep 9 23:14:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 23:14:51.980477 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-34d1bd9e-9599-41d9-9688-1d47a3963343 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:51.996412 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-34d1bd9e-9599-41d9-9688-1d47a3963343 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019436 Sep 09 23:14:51.997098 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Sep 9 23:14:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:14:52.006500 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-460ba67d-eacc-4867-973e-42e0b12749c3 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:52.022240 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-460ba67d-eacc-4867-973e-42e0b12749c3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019269 Sep 09 23:14:52.022790 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Sep 9 23:14:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:14:52.031883 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-e0c60ab7-dbb1-45b1-8985-18d577ec4781 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:52.036789 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.wsgi [None req-e0c60ab7-dbb1-45b1-8985-18d577ec4781 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-e0c60ab7-dbb1-45b1-8985-18d577ec4781 admin admin] Request method failure captured: Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Accept: application/json Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Accept-Encoding: gzip, deflate Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Connection: keep-alive Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Content-Length: 0 Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Host: 10.222.0.20 Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Openstack-Api-Version: compute 2.92 Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Openstack-System-Scope: None Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: User-Agent: python-novaclient Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Auth-Token: gAAAAABjG8jrnXLQG58j17BUU1DCmGyPvxicnuLFAOyUH-2eIxzVDeRUFwtMcEgC9-ck2pI2kYutbBjQMb_CGSOeBsHHN_2Hbbv26lmZWfQysobSifuQjPTohob9imc74r4v814mq-tHlRSjx46iKfW1_Eql1ebgSK3kMq2x0PCPiZ-hfMj6x0o Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Domain-Id: None Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Domain-Name: None Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Identity-Status: Confirmed Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Is-Admin-Project: True Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Project-Domain-Id: default Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Project-Domain-Name: Default Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Project-Id: 7393fe084b62454e9d96e9d57737a145 Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Project-Name: admin Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Role: reader,admin,member Sep 09 23:14:52.038282 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Roles: reader,admin,member Sep 09 23:14:52.039863 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7393fe084b62454e9d96e9d57737a145", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:14:52.039863 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Tenant: admin Sep 09 23:14:52.039863 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Tenant-Id: 7393fe084b62454e9d96e9d57737a145 Sep 09 23:14:52.039863 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Tenant-Name: admin Sep 09 23:14:52.039863 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-User: admin Sep 09 23:14:52.039863 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-User-Domain-Id: default Sep 09 23:14:52.039863 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-User-Domain-Name: Default Sep 09 23:14:52.039863 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-User-Id: e84ee63259eb48d0a32d4ab69da0f378 Sep 09 23:14:52.039863 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-User-Name: admin Sep 09 23:14:52.039863 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: method: > Sep 09 23:14:52.039863 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: exception: Flavor 84 could not be found. Sep 09 23:14:52.039863 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: action_args: {'id': '84'} Sep 09 23:14:52.039863 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:14:52.039863 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:52.040998 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Sep 09 23:14:52.042422 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-e0c60ab7-dbb1-45b1-8985-18d577ec4781 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:14:52.043750 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-e0c60ab7-dbb1-45b1-8985-18d577ec4781 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011351 Sep 09 23:14:52.043750 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Sep 9 23:14:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 23:14:53.285902 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-460ba67d-eacc-4867-973e-42e0b12749c3 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:53.286946 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-460ba67d-eacc-4867-973e-42e0b12749c3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 09 23:14:53.287343 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 23:14:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:53.819133 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-4cafb533-dec3-4eae-a424-3ea4db1aed32 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:53.824936 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.wsgi [None req-4cafb533-dec3-4eae-a424-3ea4db1aed32 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-4cafb533-dec3-4eae-a424-3ea4db1aed32 admin admin] Request method failure captured: Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Accept: application/json Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Accept-Encoding: gzip, deflate Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Connection: keep-alive Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Content-Length: 0 Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Host: 10.222.0.20 Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Openstack-Api-Version: compute 2.92 Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Openstack-System-Scope: None Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: User-Agent: python-novaclient Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Auth-Token: gAAAAABjG8jtMez1HKrTlZkWpatk3xzyLsP2tqaTMIx89bIm-7ocdKCiszN-LBAIGYTQpTNFnOUWyaN29Lt19HkdFTiVdd88hvszgl53UaLJBB-UakOZqT3Te2YXAHm7SVqv84XKktNjYwXpoRoDM71Rj4zJS91SZF1hsl8seseaTD76rTRlu0Q Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Domain-Id: None Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Domain-Name: None Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Identity-Status: Confirmed Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Is-Admin-Project: True Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Project-Domain-Id: default Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Project-Domain-Name: Default Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Project-Id: 7393fe084b62454e9d96e9d57737a145 Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Project-Name: admin Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Role: reader,admin,member Sep 09 23:14:53.826452 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Roles: reader,admin,member Sep 09 23:14:53.827834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7393fe084b62454e9d96e9d57737a145", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:14:53.827834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Tenant: admin Sep 09 23:14:53.827834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Tenant-Id: 7393fe084b62454e9d96e9d57737a145 Sep 09 23:14:53.827834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-Tenant-Name: admin Sep 09 23:14:53.827834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-User: admin Sep 09 23:14:53.827834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-User-Domain-Id: default Sep 09 23:14:53.827834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-User-Domain-Name: Default Sep 09 23:14:53.827834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-User-Id: e84ee63259eb48d0a32d4ab69da0f378 Sep 09 23:14:53.827834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: X-User-Name: admin Sep 09 23:14:53.827834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: method: > Sep 09 23:14:53.827834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: exception: Flavor 451 could not be found. Sep 09 23:14:53.827834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: action_args: {'id': '451'} Sep 09 23:14:53.827834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:14:53.827834 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:53.828639 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: ERROR nova.api.openstack.wsgi Sep 09 23:14:53.829899 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-4cafb533-dec3-4eae-a424-3ea4db1aed32 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106013) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:14:53.831156 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-4cafb533-dec3-4eae-a424-3ea4db1aed32 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.396983 Sep 09 23:14:53.831156 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Sep 9 23:14:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 23:14:53.838619 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-63d677b8-1498-46d8-b6b3-67bb6cb98dbb admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:53.854084 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-63d677b8-1498-46d8-b6b3-67bb6cb98dbb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019145 Sep 09 23:14:53.854672 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Sep 9 23:14:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:14:53.864048 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-1ab5e691-9ba7-4071-a6b0-90f68f6912ec admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:53.878823 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-1ab5e691-9ba7-4071-a6b0-90f68f6912ec admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018274 Sep 09 23:14:53.879351 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Sep 9 23:14:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:14:53.888967 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-a518f3f2-b5cd-4874-80f6-7cbe0a2441ba admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:53.893798 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.wsgi [None req-a518f3f2-b5cd-4874-80f6-7cbe0a2441ba admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-a518f3f2-b5cd-4874-80f6-7cbe0a2441ba admin admin] Request method failure captured: Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Accept: application/json Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Accept-Encoding: gzip, deflate Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Connection: keep-alive Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Content-Length: 0 Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Host: 10.222.0.20 Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Openstack-Api-Version: compute 2.92 Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Openstack-System-Scope: None Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: User-Agent: python-novaclient Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Auth-Token: gAAAAABjG8jtMez1HKrTlZkWpatk3xzyLsP2tqaTMIx89bIm-7ocdKCiszN-LBAIGYTQpTNFnOUWyaN29Lt19HkdFTiVdd88hvszgl53UaLJBB-UakOZqT3Te2YXAHm7SVqv84XKktNjYwXpoRoDM71Rj4zJS91SZF1hsl8seseaTD76rTRlu0Q Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Domain-Id: None Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Domain-Name: None Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Identity-Status: Confirmed Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Is-Admin-Project: True Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Project-Domain-Id: default Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Project-Domain-Name: Default Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Project-Id: 7393fe084b62454e9d96e9d57737a145 Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Project-Name: admin Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Role: reader,admin,member Sep 09 23:14:53.895321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Roles: reader,admin,member Sep 09 23:14:53.896829 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7393fe084b62454e9d96e9d57737a145"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7393fe084b62454e9d96e9d57737a145", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:14:53.896829 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Tenant: admin Sep 09 23:14:53.896829 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Tenant-Id: 7393fe084b62454e9d96e9d57737a145 Sep 09 23:14:53.896829 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-Tenant-Name: admin Sep 09 23:14:53.896829 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-User: admin Sep 09 23:14:53.896829 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-User-Domain-Id: default Sep 09 23:14:53.896829 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-User-Domain-Name: Default Sep 09 23:14:53.896829 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-User-Id: e84ee63259eb48d0a32d4ab69da0f378 Sep 09 23:14:53.896829 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: X-User-Name: admin Sep 09 23:14:53.896829 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: method: > Sep 09 23:14:53.896829 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: exception: Flavor 451 could not be found. Sep 09 23:14:53.896829 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: action_args: {'id': '451'} Sep 09 23:14:53.896829 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:14:53.896829 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:53.897820 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 09 23:14:53.899060 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-a518f3f2-b5cd-4874-80f6-7cbe0a2441ba admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:14:53.900038 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-a518f3f2-b5cd-4874-80f6-7cbe0a2441ba admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011281 Sep 09 23:14:53.900038 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Sep 9 23:14:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 23:14:55.126009 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-1ab5e691-9ba7-4071-a6b0-90f68f6912ec admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:55.127041 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-1ab5e691-9ba7-4071-a6b0-90f68f6912ec admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 09 23:14:55.127439 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 23:14:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:55.649334 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-5a800105-d317-46cc-a007-d6c5737d7c42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:55.756129 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-5a800105-d317-46cc-a007-d6c5737d7c42 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.493072 Sep 09 23:14:55.756679 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Sep 9 23:14:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 23:14:56.982823 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-1ab5e691-9ba7-4071-a6b0-90f68f6912ec admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:56.983826 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-1ab5e691-9ba7-4071-a6b0-90f68f6912ec admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 09 23:14:56.984216 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 23:14:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:57.507646 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-89fdf7ec-a812-48cc-b416-d905216ae091 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:57.568407 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-89fdf7ec-a812-48cc-b416-d905216ae091 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.444840 Sep 09 23:14:57.569236 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Sep 9 23:14:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:14:58.796219 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-1ab5e691-9ba7-4071-a6b0-90f68f6912ec admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:14:58.797220 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-1ab5e691-9ba7-4071-a6b0-90f68f6912ec admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 09 23:14:58.797615 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 23:14:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:14:59.328933 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-8d607663-443c-401d-a6dc-2ad91f79d4ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:14:59.404996 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-8d607663-443c-401d-a6dc-2ad91f79d4ff admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.468226 Sep 09 23:14:59.405535 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Sep 9 23:14:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:15:00.648414 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-1ab5e691-9ba7-4071-a6b0-90f68f6912ec admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:15:00.649415 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-1ab5e691-9ba7-4071-a6b0-90f68f6912ec admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Sep 09 23:15:00.649813 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 23:15:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:15:01.177842 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-9109d06e-37b3-4847-8a56-f8685d9738c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:15:01.279076 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-9109d06e-37b3-4847-8a56-f8685d9738c9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.483459 Sep 09 23:15:01.279620 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Sep 9 23:15:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:15:02.500664 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-1ab5e691-9ba7-4071-a6b0-90f68f6912ec admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:15:02.501670 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-1ab5e691-9ba7-4071-a6b0-90f68f6912ec admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 09 23:15:02.502086 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 23:15:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:15:03.035601 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-cb0358d5-f382-4edd-bcb0-135de53f1880 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:15:03.055964 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-cb0358d5-f382-4edd-bcb0-135de53f1880 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.416414 Sep 09 23:15:03.056551 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Fri Sep 9 23:15:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:16:00.602460 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-1ab5e691-9ba7-4071-a6b0-90f68f6912ec admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:16:00.603799 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-1ab5e691-9ba7-4071-a6b0-90f68f6912ec admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Sep 09 23:16:00.604269 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 23:16:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:16:00.614867 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:16:01.007030 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-2fac73eb-7d81-4d7b-bff0-07ea2bb27037 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:16:01.028076 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-2fac73eb-7d81-4d7b-bff0-07ea2bb27037 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.417640 Sep 09 23:16:01.028547 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Sep 9 23:16:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:16:01.049265 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG dbcounter [-] [106013] Writing DB stats nova_api:SELECT=14 {{(pid=106013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:16:01.053058 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-43c083dd-0a06-473f-ad26-97b747702bf8 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:16:01.061074 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-43c083dd-0a06-473f-ad26-97b747702bf8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013163 Sep 09 23:16:01.061620 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Fri Sep 9 23:16:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:16:01.073996 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-d9c0ddfe-3fbd-4534-bb68-1537374e8cec admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:16:01.081177 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-d9c0ddfe-3fbd-4534-bb68-1537374e8cec admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011401 Sep 09 23:16:01.081679 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Fri Sep 9 23:16:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:16:01.093737 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-a7b68a83-f057-4be5-8406-ad6605fabe34 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:16:01.101393 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-a7b68a83-f057-4be5-8406-ad6605fabe34 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011486 Sep 09 23:16:01.101907 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Fri Sep 9 23:16:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:16:01.113024 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-85f99eec-d8e3-4994-9836-5bb35fb94ee5 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:16:01.120781 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-85f99eec-d8e3-4994-9836-5bb35fb94ee5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011170 Sep 09 23:16:01.121297 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Fri Sep 9 23:16:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:19:07.783754 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-a7b68a83-f057-4be5-8406-ad6605fabe34 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:19:07.784788 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-a7b68a83-f057-4be5-8406-ad6605fabe34 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 09 23:19:07.785179 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 23:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:19:07.925717 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_api:SELECT=6 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:19:08.087190 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-17226aa6-bcd9-435f-a165-c121368e1b5e admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:19:08.092461 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-17226aa6-bcd9-435f-a165-c121368e1b5e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:19:08.092932 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-17226aa6-bcd9-435f-a165-c121368e1b5e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:19:08.093353 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-17226aa6-bcd9-435f-a165-c121368e1b5e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:19:08.094067 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-17226aa6-bcd9-435f-a165-c121368e1b5e admin admin] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:19:08.094555 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-17226aa6-bcd9-435f-a165-c121368e1b5e admin admin] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:19:08.094969 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-17226aa6-bcd9-435f-a165-c121368e1b5e admin admin] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:19:08.125779 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-17226aa6-bcd9-435f-a165-c121368e1b5e admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.201300 Sep 09 23:19:08.126321 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Sep 9 23:19:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:19:09.211414 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-a7b68a83-f057-4be5-8406-ad6605fabe34 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:19:09.212432 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-a7b68a83-f057-4be5-8406-ad6605fabe34 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 09 23:19:09.212838 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 23:19:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:19:09.410189 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-a27c30c5-d2e7-4019-88c6-701129a463ae admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:19:09.411502 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-a27c30c5-d2e7-4019-88c6-701129a463ae admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:19:09.412073 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-a27c30c5-d2e7-4019-88c6-701129a463ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:19:09.412558 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-a27c30c5-d2e7-4019-88c6-701129a463ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:19:09.413278 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-a27c30c5-d2e7-4019-88c6-701129a463ae admin admin] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:19:09.413720 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-a27c30c5-d2e7-4019-88c6-701129a463ae admin admin] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:19:09.414132 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-a27c30c5-d2e7-4019-88c6-701129a463ae admin admin] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:19:09.436278 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-a27c30c5-d2e7-4019-88c6-701129a463ae admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.083014 Sep 09 23:19:09.436843 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Sep 9 23:19:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:19:20.960353 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-a7b68a83-f057-4be5-8406-ad6605fabe34 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:19:20.961351 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-a7b68a83-f057-4be5-8406-ad6605fabe34 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Sep 09 23:19:20.961746 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 23:19:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:19:21.106008 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_cell0:SELECT=4 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:19:21.106758 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_cell1:SELECT=4 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:19:21.107362 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_api:SELECT=8 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:19:21.156795 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-293a9842-938e-4d2c-bfa8-d8f40a32b733 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:19:21.160249 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-293a9842-938e-4d2c-bfa8-d8f40a32b733 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:19:21.160810 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-293a9842-938e-4d2c-bfa8-d8f40a32b733 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:19:21.161234 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-293a9842-938e-4d2c-bfa8-d8f40a32b733 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:19:21.161935 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-293a9842-938e-4d2c-bfa8-d8f40a32b733 admin admin] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:19:21.162393 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-293a9842-938e-4d2c-bfa8-d8f40a32b733 admin admin] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:19:21.162804 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-293a9842-938e-4d2c-bfa8-d8f40a32b733 admin admin] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:19:21.188364 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-293a9842-938e-4d2c-bfa8-d8f40a32b733 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.086749 Sep 09 23:19:21.188922 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Sep 9 23:19:21 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:19:22.274781 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG nova.api.openstack.wsgi [None req-a7b68a83-f057-4be5-8406-ad6605fabe34 admin admin] Calling method '>' {{(pid=106013) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:19:22.275792 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: INFO nova.api.openstack.requestlog [None req-a7b68a83-f057-4be5-8406-ad6605fabe34 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 09 23:19:22.276189 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: [pid: 106013|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 23:19:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:19:22.469435 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-bb0b123f-e0c2-47fe-8ce9-4a98dadf523c admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:19:22.472867 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-bb0b123f-e0c2-47fe-8ce9-4a98dadf523c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:19:22.473377 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-bb0b123f-e0c2-47fe-8ce9-4a98dadf523c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:19:22.473808 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-bb0b123f-e0c2-47fe-8ce9-4a98dadf523c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:19:22.474558 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-bb0b123f-e0c2-47fe-8ce9-4a98dadf523c admin admin] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:19:22.475262 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-bb0b123f-e0c2-47fe-8ce9-4a98dadf523c admin admin] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:19:22.475729 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-bb0b123f-e0c2-47fe-8ce9-4a98dadf523c admin admin] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:19:22.499012 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-bb0b123f-e0c2-47fe-8ce9-4a98dadf523c admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.083043 Sep 09 23:19:22.499497 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Sep 9 23:19:22 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:20:21.464420 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: Fri Sep 9 23:20:21 2022 - graceful shutdown triggered... Sep 09 23:20:21.464311 dv-cinder-850321-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 09 23:20:21.465400 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: Gracefully killing worker 1 (pid: 106013)... Sep 09 23:20:21.465780 dv-cinder-850321-6-iscsi devstack@n-api.service[106014]: Gracefully killing worker 2 (pid: 106014)... Sep 09 23:20:21.590854 dv-cinder-850321-6-iscsi devstack@n-api.service[106013]: DEBUG dbcounter [-] [106013] Writing DB stats nova_api:SELECT=4 {{(pid=106013) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:20:22.465336 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: worker 1 buried after 1 seconds Sep 09 23:20:22.465797 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: worker 2 buried after 1 seconds Sep 09 23:20:22.465797 dv-cinder-850321-6-iscsi devstack@n-api.service[106012]: goodbye to uWSGI. Sep 09 23:20:22.467522 dv-cinder-850321-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 09 23:20:22.468070 dv-cinder-850321-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 09 23:20:22.470952 dv-cinder-850321-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 23:20:22.484820 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 23:20:22.487969 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 23:20:22 2022] *** Sep 09 23:20:22.487969 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 23:20:22.487969 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 23:20:22.487969 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: nodename: dv-cinder-850321-6-iscsi Sep 09 23:20:22.487969 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: machine: x86_64 Sep 09 23:20:22.487969 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: clock source: unix Sep 09 23:20:22.487969 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: pcre jit disabled Sep 09 23:20:22.487969 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: detected number of CPU cores: 4 Sep 09 23:20:22.487969 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: current working directory: / Sep 09 23:20:22.487969 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: detected binary path: /usr/bin/uwsgi-core Sep 09 23:20:22.489249 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: your processes number limit is 47680 Sep 09 23:20:22.489249 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: your memory page size is 4096 bytes Sep 09 23:20:22.489249 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: detected max file descriptor number: 2048 Sep 09 23:20:22.489249 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: lock engine: pthread robust mutexes Sep 09 23:20:22.489249 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: thunder lock: enabled Sep 09 23:20:22.489249 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 23:20:22.489249 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 23:20:22.530332 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: Python main interpreter initialized at 0x5587b5b6b9c0 Sep 09 23:20:22.530332 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: python threads support enabled Sep 09 23:20:22.530332 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: your server socket listen backlog is limited to 100 connections Sep 09 23:20:22.530332 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: your mercy for graceful operations on workers is 90 seconds Sep 09 23:20:22.530760 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 23:20:22.530850 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: *** Operational MODE: preforking *** Sep 09 23:20:22.531116 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: *** uWSGI is running in multiple interpreter mode *** Sep 09 23:20:22.531116 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: spawned uWSGI master process (pid: 121039) Sep 09 23:20:22.531319 dv-cinder-850321-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 23:20:22.533890 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: spawned uWSGI worker 1 (pid: 121058, cores: 1) Sep 09 23:20:22.533890 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: spawned uWSGI worker 2 (pid: 121059, cores: 1) Sep 09 23:20:22.533890 dv-cinder-850321-6-iscsi devstack@n-api.service[121039]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 23:20:23.212571 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 23:20:23.213538 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 23:20:24.390281 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 23:20:24.390281 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: from cryptography.utils import int_from_bytes Sep 09 23:20:24.391061 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 23:20:24.391061 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: from cryptography.utils import int_from_bytes Sep 09 23:20:24.402703 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 23:20:24.402703 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: from cryptography.utils import int_from_bytes Sep 09 23:20:24.403292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 23:20:24.403292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: from cryptography.utils import int_from_bytes Sep 09 23:20:26.844842 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 23:20:26.845422 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 23:20:26.845708 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 23:20:26.846022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 23:20:26.846281 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 23:20:26.846703 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.847039 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.847367 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.847689 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.848023 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.848341 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.848810 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.848984 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.849319 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.849586 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.849915 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.850443 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-6-iscsi {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.850970 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.851295 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.851875 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.852213 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.852527 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.852857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.853168 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.853685 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.854628 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.855435 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.855435 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.855435 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.855828 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.856059 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.856390 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.856708 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.857045 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.857486 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.858630 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-6-iscsi {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.859043 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.859375 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.859716 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.860144 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.860467 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.860790 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.861120 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.861461 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.861776 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.862119 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.862468 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.862805 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.863124 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.863457 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.863776 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.864089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.864416 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.864773 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.865040 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.867353 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.867778 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.868109 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.868438 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.868772 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.869025 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.869285 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.869614 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.869944 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.870258 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.870601 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.870921 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.871235 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.871548 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.871863 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.872176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.872498 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.872827 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.873263 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.873771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.874159 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.874519 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.874939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.875197 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.875511 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.875860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.876184 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.876498 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.876821 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.877146 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.877458 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.877769 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.878081 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.878433 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.878787 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.879091 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.879350 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.879654 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.879970 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.880282 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.880596 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.880907 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.881217 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.881520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.881836 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.882146 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.882484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.882817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.883106 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.883419 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.883729 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.884040 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.884353 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.884662 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.884992 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.885315 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.885627 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.885938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.886249 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.886590 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.886914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.887226 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.887539 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.887867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.888177 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.888486 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.888844 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.889151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.889465 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.889870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.890092 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.890429 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.890752 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.891062 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.891371 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.891677 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.891984 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.892298 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.892604 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.892911 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.893219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.893521 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.893844 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.894172 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.894588 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.894903 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.895214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.895537 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.895882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.896218 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.896565 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.896884 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.897397 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.897742 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.898067 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.898406 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.898731 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.899064 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.899457 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.899685 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 23:20:26.900197 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.900382 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 23:20:26.900535 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.900535 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.900821 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 23:20:26.900973 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.901194 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 23:20:26.901359 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.901512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 23:20:26.901660 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.901809 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.901956 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.902105 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.902262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.902468 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.902611 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.902758 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.902945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.903100 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.903240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.903386 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.903533 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.903673 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.903922 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.904070 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.904784 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.904975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.905146 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.905296 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.905296 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.905700 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.905700 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.905985 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.906126 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-6-iscsi {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.907127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.907127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.907514 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.907658 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.907827 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.908004 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.908158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.908299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.908662 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.908817 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.908983 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.909242 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.909417 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.909618 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.909775 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.909948 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.910102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.910250 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.910453 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.910611 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.910752 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.910892 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.911087 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.911250 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.911414 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.911568 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.911716 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.911855 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.912056 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.912224 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.912366 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.912512 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.912698 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.912845 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.913016 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.913172 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.913358 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.913510 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-6-iscsi {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.913683 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.913836 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.914084 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.914241 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.914421 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.914568 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.914749 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.914904 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.915047 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.915275 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.915431 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.915626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.915771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.915919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.916059 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.916197 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.916424 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.917155 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.917605 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.917764 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.917929 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.918082 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.918232 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.918411 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.918639 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.918891 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.919048 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.919189 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.919337 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.919494 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.919645 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.919793 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.920653 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.920819 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.920968 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.921114 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.921268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.921407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.921546 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.921694 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.921842 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.921993 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.922144 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.922284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.922460 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.922460 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.922733 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.922874 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.923023 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.923023 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.923300 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.923439 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.923579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.923743 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.923943 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.924090 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.924232 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.924378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.924518 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.924671 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.924812 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.924959 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.925107 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.925272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.925426 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.925583 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.925785 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.925927 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.926074 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.926213 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.926400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.926561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.926719 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.927420 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.927810 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.927976 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.928132 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.928279 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.928437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.928580 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.928727 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.928892 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.929132 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.929132 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.929411 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.929411 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.929743 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.929898 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.930039 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.930039 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.930321 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.930500 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.930651 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.930793 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.931004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.931253 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.931501 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.931737 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.932002 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.932269 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.932548 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.932804 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.933053 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.933053 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.933053 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.933601 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.933750 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.933902 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.934042 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.934042 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.934316 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.934498 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.934650 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.934798 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.934937 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.935082 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.935221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.935379 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.935796 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.935963 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.936113 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.936254 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.936402 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.936558 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.936706 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.936846 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.937006 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.937736 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.938111 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.938289 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.938525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.938678 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.938820 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.938959 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.939125 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.939369 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.939525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.939673 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.939814 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.939991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.940144 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.940299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.940299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.940646 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.940794 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.940934 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.941086 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.941086 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.941352 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.941490 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.941630 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.941782 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.941923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.942070 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.942217 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.942416 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.942627 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.942776 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.942916 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.943078 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.943235 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.943384 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.943384 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.943656 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.943805 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.943805 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.943805 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.943805 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.943805 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.944489 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.944629 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.944769 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.944916 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.945069 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.945220 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.945367 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.945367 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.945638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.945900 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.945900 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.946200 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.946375 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.946522 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.946662 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.946818 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.947008 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.947160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.947160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.948006 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.948386 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.948550 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.948693 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.948842 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.948995 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.949155 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.949511 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.949668 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.949819 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.949969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.950117 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.950257 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.950414 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.950672 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.950852 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.950998 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.951189 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 23:20:26.951349 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.951500 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.951642 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.951789 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.952022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.952022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.952400 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.952558 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.952699 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.952846 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.952997 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.953147 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.953287 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.953530 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.953682 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.953830 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.953977 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.954117 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.954271 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.954451 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.954451 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.954789 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.954938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.955079 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.955239 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.955390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.955531 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.955670 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.955855 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.956049 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.956201 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.956343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.956490 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.956631 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.956777 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.956916 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.957064 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.957203 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.957361 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.957500 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.958240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.958698 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.958856 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.959006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.959153 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.959293 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.959442 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.959701 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.959981 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.960142 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.960292 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.960452 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.960594 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.960747 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.960889 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.961035 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.961182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.961336 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.961478 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.961628 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.961776 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.961923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.962071 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.962212 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.962389 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.962547 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.962690 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.962690 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.962960 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.963108 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.963256 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.963404 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.963552 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.963692 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.963837 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.963984 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.964142 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.964290 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.964459 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.964603 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.964745 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.964892 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.965045 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.965186 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.965332 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.965472 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.965617 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.965772 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.965920 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.966118 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.966281 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.966562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.967259 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.967510 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.967664 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.968437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.968613 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.968613 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.969128 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.969280 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.969428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.969576 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.969576 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.970084 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.970256 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.970437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.970592 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.970745 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.970892 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.971041 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.971188 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.971338 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.971487 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.971640 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.971795 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.971950 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.972090 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.972237 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.972377 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.972523 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.972672 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.972813 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.972953 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.973103 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.975886 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.976069 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.976292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.976464 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.976869 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.977024 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.977167 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.977358 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.977571 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.977721 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.977872 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.978579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.978762 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.978949 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.979316 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.979468 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.979629 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.979778 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.980024 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.980184 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.980336 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.980488 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.980630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.980778 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.980918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.981067 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.981207 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.981207 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.981207 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.981207 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.981207 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.982063 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.982204 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.982204 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.983142 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.983142 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.983427 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.983569 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.983717 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.983855 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.983855 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.984216 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.984379 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.984379 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.984730 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.984872 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.985011 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.985149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.985297 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.985519 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.985665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.985813 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.985961 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.986111 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.986309 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.986479 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.986620 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.986760 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.986976 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.987136 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.987286 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.987427 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.987576 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.987717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.987857 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.988064 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.988414 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.988886 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.989051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.989051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.989601 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.989746 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.989900 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.990066 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.990200 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.990325 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.990482 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.990482 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.990731 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.990865 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.990992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.991125 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.991265 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.991400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.991526 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.991658 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.991783 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.991908 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.992047 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.992181 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.992316 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.992441 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.992574 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.992700 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.992834 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.992968 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.993094 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.993227 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.993360 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.993500 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.993671 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.993808 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.993941 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.994092 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.994232 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.994382 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.994510 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.994647 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.994647 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.994909 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.995044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.995184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.995319 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.995489 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.995628 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.995762 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.995762 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.995762 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.995762 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.995762 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.996447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.996581 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.996581 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.996581 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.996947 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.997074 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.997074 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.997074 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.997074 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.997543 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.997668 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.997668 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.997668 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.998089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.998313 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.998313 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.998313 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.998313 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.999863 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.999986 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.999986 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:26.999986 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.000308 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.000426 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.000426 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.000426 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.000426 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.000830 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.000939 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.000939 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.001147 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.001262 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.001396 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.001396 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.001730 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.001730 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.001730 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.001730 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.001730 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.001730 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.001730 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.002455 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.002455 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.002455 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.002849 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.003073 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.003396 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.003713 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.003890 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.004057 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.004324 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.004462 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.004643 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.004975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.005292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.005620 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.005947 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.006084 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.006258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.006529 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.006677 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.006930 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.007178 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.007317 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.007546 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.007857 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.007995 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.008165 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.008366 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.008754 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.009403 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.009403 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.009930 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.010065 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.010202 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.010329 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.010538 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.010828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.011174 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.011350 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.011508 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.011838 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.011992 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.012178 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.012458 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.012588 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.012815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.012962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.013140 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.013428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.013924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.013924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.014192 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.014395 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.014550 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.014805 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.015128 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.015453 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.015777 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.016094 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.016414 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.016678 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.016808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.017002 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.017330 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.017469 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.017699 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.018006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.018349 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.018881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.019052 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.019536 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.019671 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.019849 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.020170 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.020170 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.020416 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.020607 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.020920 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.021060 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.021234 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.021516 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.021655 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.021856 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.022129 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.022277 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.022495 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.022676 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.022808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.023409 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.023551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.023678 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.023815 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.023950 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.023950 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.024242 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.024380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.024578 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.024719 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.024899 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.025208 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.025419 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.025553 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.025834 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.025975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.026144 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.026406 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.026601 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.026850 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.027133 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.027275 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.027439 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.027789 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.028001 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.028199 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.028411 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.028627 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.028866 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.031036 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.031181 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.031313 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.031465 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.031596 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.031724 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.031724 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.031957 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.032072 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.032072 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.032294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.032410 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.032410 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.032410 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.032744 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.033062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.033361 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.033491 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.033677 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.033885 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.034082 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.034293 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.034649 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.034788 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.034968 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.035195 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.035335 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.035572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.035747 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.035927 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.036191 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.036524 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.036723 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.037010 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.037219 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.037468 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.037772 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.038020 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.038161 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.038446 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.038674 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.038806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.039077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.039411 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.039546 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.039682 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.039810 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.040218 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.040447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.040592 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.040932 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.041075 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.041075 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.041318 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.041445 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.041584 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.041711 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.041844 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.042157 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.042289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.042567 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.042823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.043150 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.043862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.043997 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.043997 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.044343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.044482 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.044609 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.044745 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.045035 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.045245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.045484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.045858 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.046285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.046610 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.046850 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.046850 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.047107 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.047236 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.047236 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.047540 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.047862 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.048006 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.048180 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.048497 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.048643 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.048810 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.049030 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.049185 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.049670 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.049812 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.050050 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.050612 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.050612 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.050890 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.051247 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.051388 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.051388 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.051687 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.051838 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.052010 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.052333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.052549 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.052687 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.052963 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.053277 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.053416 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.053585 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.053919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.054126 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.054257 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.054571 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.054902 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.055034 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.055233 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.055566 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.055761 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.055901 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.056187 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.056506 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.056644 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.057034 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.057170 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.057354 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.057747 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.058009 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.058294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.058473 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.058602 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.058728 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.059019 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.059178 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.059337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.059429 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.059661 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.059988 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.060298 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.061221 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.061393 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.061687 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.061796 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.062023 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.062268 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.062629 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.062959 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.063126 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.063276 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.063480 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.063601 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.063915 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.064366 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.064689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.064934 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.065032 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.065301 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.065401 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.065622 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.065712 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.065943 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.066194 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.066299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.066608 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.066707 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.066924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.067024 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.067347 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.067734 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.067863 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.068328 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.068418 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.068655 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.068760 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.069035 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.069354 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.069444 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.069684 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.069780 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.070015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.070102 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.070333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.070458 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.070678 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.070783 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.070993 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.071092 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.071329 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.071436 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.071643 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.071975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.072067 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.072353 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.072444 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.072690 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.072791 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.073016 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.073441 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.073762 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.074083 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.074465 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.074584 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.074772 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.074873 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.075107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.075207 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.075422 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.075743 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.076064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.077072 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.077205 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.077460 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.077619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.077797 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.077950 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.078133 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.078280 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.078626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.078966 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.079301 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.079570 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.079670 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.079953 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.080057 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.080239 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.080367 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.080575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.080703 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.080906 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.081028 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.081234 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.081417 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.081561 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.081695 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.081902 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.082045 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.082325 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.082500 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.082596 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.082727 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.082905 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.083068 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.083247 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.083905 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.084083 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.084236 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.084433 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.084580 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.084753 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.084909 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.085079 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.085378 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.085459 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.085708 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.085957 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.086038 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.086328 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.086541 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.086686 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.086984 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.087240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.088206 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.088293 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.088569 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.088671 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.088923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.089273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.089618 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.089946 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.090047 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.090291 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.091362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.091483 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.091562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.091634 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.091634 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.091839 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.091986 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.092108 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.092194 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.092434 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.092542 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.092674 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.092976 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.093257 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.093357 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.093761 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.093905 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.094097 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.094458 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.094552 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.094792 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.094995 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.095278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.095412 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.095672 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.095849 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.096003 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.096177 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.096330 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.096479 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.096643 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.096795 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.096956 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.097132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.097370 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.097525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.097682 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.097831 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.097978 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.098154 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.098323 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.098526 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.098683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.098837 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.099005 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.099178 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.099333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.099491 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.099642 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.099798 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.099965 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.100116 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.100287 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.100427 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.100538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.100653 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.100759 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.100972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.101282 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.101374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.101852 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.102167 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.102386 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.102595 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.102703 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.102854 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.103017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.103202 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.103355 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.103522 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.103765 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.103855 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.104170 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.104368 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.104495 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.104866 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.105006 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.105145 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.105406 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.105515 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.105745 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.105846 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.106083 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.106175 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.106424 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.106735 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.106836 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.107059 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.107419 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.107703 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.108059 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.108318 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.108419 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.108667 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.108759 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.108997 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.109103 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.109325 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.109430 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.109649 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.109741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.109974 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.110075 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.110297 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.110417 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.110645 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.110733 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.110965 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.111061 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.111286 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.111386 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.111609 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.111763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.111945 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.112129 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.112277 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.112497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.112637 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.112879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.113013 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.113295 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.113598 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.113922 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.114042 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.114246 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.114451 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.114669 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.114782 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.114994 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.115311 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.115637 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.115742 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.115961 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.116061 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.116286 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.116377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.116608 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.116929 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.117251 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.117572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.117728 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.117893 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.118081 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.118212 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.118462 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.118606 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.118867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.119102 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.119195 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.119461 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.119566 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.119848 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.120163 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.120380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.120645 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.120781 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.121126 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.121281 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.121467 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.122026 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.122177 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.122410 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.122739 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.123694 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.124165 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.124563 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.124901 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.125247 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.125568 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.125885 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.126210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.126598 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.126704 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.126875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.126981 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.127210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.127362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.127534 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.127851 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.128179 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.128498 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.128966 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.129130 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.129326 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.129487 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.129676 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.129825 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.130028 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.130377 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.130710 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.131026 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.131176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.131360 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.131674 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.131831 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.131974 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.132297 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.132616 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.133010 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.133237 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.133560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.133875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.134159 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.134311 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.134506 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.134657 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.134807 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.134948 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.135138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.135294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.135445 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.135611 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.135759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.135964 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.136119 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.136321 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.136478 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.136634 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.136775 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.136939 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.137087 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.137246 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.137400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.137591 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.137741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.137883 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.138031 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.138181 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.138384 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.138576 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.139437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.139596 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.139868 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.140026 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.140220 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.140706 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.140890 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.141032 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.141341 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.141602 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.141760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.141981 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.142253 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.142420 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.142638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.142823 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.143001 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.143260 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.143417 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.143589 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.143753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.143906 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.144056 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.144242 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.144399 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.144549 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.144703 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.144983 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.145139 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.145311 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.145460 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.145644 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.145806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.145972 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.146129 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.146307 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.146518 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.146698 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.146854 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.147003 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.147151 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.147305 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.147452 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.147655 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.147810 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.147965 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.148124 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.148274 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.148429 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.148596 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.148752 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.148907 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.149061 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.149210 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.149361 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.149517 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.149674 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.149823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.149978 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.150157 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.150324 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.150514 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.150803 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.150968 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.151117 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.151365 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.151560 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.151725 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.151873 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.152028 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.152297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.152461 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.152623 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.152772 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.152930 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.153077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.153282 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.153423 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.153601 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.153726 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.153914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.154028 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.154380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.154539 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.154724 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.154825 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.155072 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.155291 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.155452 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.155615 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.155807 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.155974 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.156184 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.156428 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.156586 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.156747 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.156892 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.157028 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.157167 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.157325 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.157475 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.157617 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.157914 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.158131 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.158281 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.158572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.158761 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.158902 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.158995 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.159220 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.159360 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.159548 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.159698 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.159881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.160015 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.160201 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.160333 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.160528 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.160660 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.160848 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.160972 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.161214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.161367 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.161513 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.161631 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.161838 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.161977 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.162156 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.162308 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.162481 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.162612 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.162799 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.162925 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.163111 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.163252 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.163431 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.163564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.163749 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.163868 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.164065 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.164178 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.164376 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.164473 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.164687 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.164781 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.164999 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.165104 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.165308 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.165402 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.165619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.165721 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.165929 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.166083 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.166252 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.166514 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.166627 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.166848 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.166953 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.167157 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.167252 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.168222 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.168353 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.168445 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.168548 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.168637 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.168730 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.168818 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.168912 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.169000 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.169101 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.169195 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.169291 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.170574 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.170693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.170806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.170905 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.171006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.171112 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.171494 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.171597 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.171711 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.172831 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.172971 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.173060 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.173148 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.173234 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.173359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.173444 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.173531 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.173619 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.173694 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.173778 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.173882 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.174009 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.174170 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.174330 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.174522 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.174652 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.174752 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.174849 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.174947 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.175042 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.175129 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.175228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.175316 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.175401 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.175832 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.176181 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.176282 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.176390 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.176480 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.176577 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.176797 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.176906 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.177191 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.177340 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.177510 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.178051 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.178163 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.178252 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.178373 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.178456 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.178542 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.178770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.178866 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.179079 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.179181 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.179389 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.179474 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.179755 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.179839 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.180073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.180172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.180380 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.180464 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.180689 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.180779 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.180996 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.181213 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.181301 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.181396 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.181633 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.181718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.181893 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.183322 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.183322 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.183500 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.183576 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.183757 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.183861 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.183938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.184010 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.184082 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.184165 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.184248 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.184334 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.185578 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.186185 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.186275 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.186375 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.186481 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.186569 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.186656 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.186741 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.186842 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.186943 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.187042 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.187042 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.187208 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.187284 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.187356 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.187435 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.187518 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.187600 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.187777 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.188919 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.189031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.189125 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.189208 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.189283 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.189362 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 23:20:27.189436 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.189436 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.189576 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.189805 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.190120 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.190458 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.190795 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.191127 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.191439 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.191769 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.192092 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.192418 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.192740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.193056 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.193392 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.193705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.194020 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.194334 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.195911 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.195911 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.195911 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.195911 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.196202 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.196281 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.196553 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.196981 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.198410 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.198410 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.198410 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.198410 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.198815 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.199471 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.199471 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.199670 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.199917 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.200234 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.200545 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 23:20:27.201676 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 23:20:27.256412 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO dbcounter [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] Registered counter for database nova_api Sep 09 23:20:27.268751 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO dbcounter [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] Registered counter for database nova_api Sep 09 23:20:27.281042 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_db.sqlalchemy.engines [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:20:27.288667 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writer thread running {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:20:27.289130 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_db.sqlalchemy.engines [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:20:27.296513 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writer thread running {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:20:27.346823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.context [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c(cell1) {{(pid=121059) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 23:20:27.350914 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:20:27.351387 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:20:27.352609 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.context [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c(cell1) {{(pid=121058) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 23:20:27.353352 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:20:27.354095 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:20:27.354574 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:20:27.364571 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:20:27.364906 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:20:27.364906 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:20:27.364906 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:20:27.365161 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO dbcounter [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] Registered counter for database nova_cell0 Sep 09 23:20:27.365273 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:20:27.365273 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:20:27.365273 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:20:27.365522 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO dbcounter [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] Registered counter for database nova_cell1 Sep 09 23:20:27.365607 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO dbcounter [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] Registered counter for database nova_cell0 Sep 09 23:20:27.368335 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO dbcounter [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] Registered counter for database nova_cell1 Sep 09 23:20:27.371729 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_db.sqlalchemy.engines [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:20:27.376726 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_db.sqlalchemy.engines [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:20:27.377428 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writer thread running {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:20:27.378769 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_db.sqlalchemy.engines [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:20:27.385759 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writer thread running {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:20:27.387075 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writer thread running {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:20:27.526821 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_db.sqlalchemy.engines [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:20:27.533201 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writer thread running {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:20:27.541782 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO dbcounter [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] Registered counter for database nova_cell0 Sep 09 23:20:27.549098 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_db.sqlalchemy.engines [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:20:27.553601 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writer thread running {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:20:27.573325 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO dbcounter [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] Registered counter for database nova_cell0 Sep 09 23:20:27.585136 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_db.sqlalchemy.engines [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 23:20:27.589724 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writer thread running {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 23:20:27.894080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: WARNING keystonemiddleware.auth_token [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 23:20:27.901589 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: WARNING keystonemiddleware.auth_token [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 23:20:27.930010 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: WARNING keystonemiddleware.auth_token [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 23:20:27.938387 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: WARNING keystonemiddleware.auth_token [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 23:20:28.254047 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: WARNING keystonemiddleware.auth_token [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 23:20:28.260030 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: WARNING keystonemiddleware.auth_token [None req-d73bfe86-2c5d-4281-9f5c-ab197db80011 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 23:20:28.265453 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587b5b6b9c0 pid: 121059 (default app) Sep 09 23:20:28.298673 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: WARNING keystonemiddleware.auth_token [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 23:20:28.304688 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: WARNING keystonemiddleware.auth_token [None req-41bff788-41a9-4b64-9515-57aab2d4adbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 23:20:28.309976 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587b5b6b9c0 pid: 121058 (default app) Sep 09 23:21:06.775596 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=3 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:06.776559 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=3 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:06.777593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=3 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:06.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=3 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:07.866163 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-22cd900f-7a1e-4ffd-b1a2-5d3f88a41cc0 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Action: 'create', calling method: .version_select at 0x7f908ed0f4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-114342949"}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:09.824928 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-22cd900f-7a1e-4ffd-b1a2-5d3f88a41cc0 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.057936 Sep 09 23:21:09.824928 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Sep 9 23:21:06 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3071 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 23:21:09.958657 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-52f2843b-a218-447e-8da8-93526412c17c tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] Calling method '.version_select at 0x7f908ebdf3a0>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:10.339657 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-52f2843b-a218-447e-8da8-93526412c17c tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5b08125b-6e1d-4f02-b866-b3da70f21609" status: 200 len: 350 microversion: 2.1 time: 0.394429 Sep 09 23:21:10.347344 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 2/2] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 23:21:09 2022] GET /compute/v2.1/os-volumes/5b08125b-6e1d-4f02-b866-b3da70f21609 => generated 350 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:21:10.434258 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-421faff5-29c5-4867-bbef-2761aab47099 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908edba4c0>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:10.521995 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=3 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:10.534526 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=3 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:10.535738 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=3 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:10.538096 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=3 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:11.209218 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-421faff5-29c5-4867-bbef-2761aab47099 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/81d6984f-b01f-48ab-af9b-9723e19850db" status: 200 len: 345 microversion: 2.1 time: 1.370371 Sep 09 23:21:11.209801 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 1/3] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 23:21:09 2022] GET /compute/v2.1/os-volumes/81d6984f-b01f-48ab-af9b-9723e19850db => generated 345 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:11.224711 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-70be1979-a04d-4852-a1e5-4cf0fdd9c6be tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Action: 'create', calling method: .version_select at 0x7f908ebdfa60>, body: {"snapshot": {"volume_id": "81d6984f-b01f-48ab-af9b-9723e19850db", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1679187258"}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:12.006448 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-70be1979-a04d-4852-a1e5-4cf0fdd9c6be tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.787210 Sep 09 23:21:12.008011 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 3/4] 10.222.0.20 () {60 vars in 1162 bytes} [Fri Sep 9 23:21:11 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:12.026509 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e50fb76b-12b0-440a-a562-833b693840cb tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908ebca430>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:12.124753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e50fb76b-12b0-440a-a562-833b693840cb tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe" status: 200 len: 287 microversion: 2.1 time: 0.107215 Sep 09 23:21:12.126122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 2/5] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 23:21:12 2022] GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:12.137451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b28bc404-afa4-426b-a55a-a1f1ac86a902 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908eb78c10>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:12.372809 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b28bc404-afa4-426b-a55a-a1f1ac86a902 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.239050 Sep 09 23:21:12.385244 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 4/6] 10.222.0.20 () {58 vars in 1140 bytes} [Fri Sep 9 23:21:12 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:12.385627 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-2c52d453-66e1-47a7-aaf7-acd32a618b91 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908ebcaa60>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:12.478862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-2c52d453-66e1-47a7-aaf7-acd32a618b91 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe" status: 200 len: 287 microversion: 2.1 time: 0.096847 Sep 09 23:21:12.479448 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 3/7] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 23:21:12 2022] GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:21:12.675263 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-21cdf418-c0d4-4737-af12-a8d411f6d56f tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] Calling method '.version_select at 0x7f908ed0fee0>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:12.799954 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-21cdf418-c0d4-4737-af12-a8d411f6d56f tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/51875f05-a71d-487d-89fa-1e3b465f092b" status: 200 len: 350 microversion: 2.1 time: 0.129770 Sep 09 23:21:12.805332 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 23:21:12 2022] GET /compute/v2.1/os-volumes/51875f05-a71d-487d-89fa-1e3b465f092b => generated 350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:13.491780 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-af1d7e0b-f105-4f61-b5e9-e65cf9057dc4 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908ebdb160>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:13.534502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-af1d7e0b-f105-4f61-b5e9-e65cf9057dc4 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe" status: 200 len: 287 microversion: 2.1 time: 0.046386 Sep 09 23:21:13.544862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 4/9] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 23:21:13 2022] GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:14.551354 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ca434425-c92c-43e0-9430-0d73a72c56dd tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908ebdf9d0>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:14.639492 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ca434425-c92c-43e0-9430-0d73a72c56dd tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe" status: 200 len: 287 microversion: 2.1 time: 0.086838 Sep 09 23:21:14.642195 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 6/10] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 23:21:14 2022] GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:15.656924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a94b9321-7265-4c7a-8f17-0e1377aa6669 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908ebdf160>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:15.723736 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a94b9321-7265-4c7a-8f17-0e1377aa6669 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe" status: 200 len: 288 microversion: 2.1 time: 0.072335 Sep 09 23:21:15.725307 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 7/11] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 23:21:15 2022] GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:21:15.739352 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-959a442e-20c6-43c9-a5b8-aadab4108aa9 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908ebdf9d0>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:15.831328 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1430312321", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "networks": [{"uuid": "46257872-8693-4437-8926-f67b08bb34c8"}]}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:15.969293 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-959a442e-20c6-43c9-a5b8-aadab4108aa9 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe" status: 202 len: 0 microversion: 2.1 time: 0.235961 Sep 09 23:21:15.970707 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 8/12] 10.222.0.20 () {58 vars in 1254 bytes} [Fri Sep 9 23:21:15 2022] DELETE /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:21:15.970869 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.network.neutron [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] validate_networks() for [('46257872-8693-4437-8926-f67b08bb34c8', None, None, None, None, None)] {{(pid=121058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:21:15.981153 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0e3ffddf-b62e-4b4f-a773-9039ddc3ffdc tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908f53b790>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:16.032701 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-0e3ffddf-b62e-4b4f-a773-9039ddc3ffdc tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe" status: 200 len: 287 microversion: 2.1 time: 0.057043 Sep 09 23:21:16.033474 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 9/13] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 23:21:15 2022] GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:21:17.045136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3cd61972-abb4-47ae-b1e1-3fad10bf1217 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908eb785e0>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:17.111707 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3cd61972-abb4-47ae-b1e1-3fad10bf1217 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe" status: 200 len: 287 microversion: 2.1 time: 0.070332 Sep 09 23:21:17.112723 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 10/14] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 23:21:17 2022] GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:18.124835 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7517d016-09c0-4de5-8e3d-a638107cd992 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908ebdf4c0>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:18.187731 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7517d016-09c0-4de5-8e3d-a638107cd992 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe" status: 200 len: 287 microversion: 2.1 time: 0.066727 Sep 09 23:21:18.189332 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 11/15] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 23:21:18 2022] GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:18.202558 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Flavor limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:21:18.203085 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Image limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:21:18.203482 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Flavor pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:21:18.204431 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Image pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:21:18.204848 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:21:18.222421 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:18.222913 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:18.223358 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:18.224156 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:18.224797 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:18.225492 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:18.289699 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Getting quotas for project b4291c4cdc1d4f4eae035c4800670101. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:21:18.298715 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Getting quotas for user a496b0d69dd24d6980fa7301b7fa2a90 and project b4291c4cdc1d4f4eae035c4800670101. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:21:18.349046 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Going to run 1 instances... {{(pid=121058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:21:18.358267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:21:18.625840 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-326c9148-9f8d-43c0-9ad1-be1833bf60db tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.039890 Sep 09 23:21:18.626242 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 5/16] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:21:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:21:18.639433 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-067a1b1c-ffa6-4c13-bfaa-b29ab87731ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:18.640188 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-067a1b1c-ffa6-4c13-bfaa-b29ab87731ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:18.919566 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-067a1b1c-ffa6-4c13-bfaa-b29ab87731ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:18.973885 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-067a1b1c-ffa6-4c13-bfaa-b29ab87731ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1215 microversion: 2.1 time: 0.338954 Sep 09 23:21:18.995172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 12/17] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:18 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1215 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:19.202534 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7288b2a6-ae3e-4e07-a022-19697494b8ae tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908e27e430>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:19.260413 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-7288b2a6-ae3e-4e07-a022-19697494b8ae tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] HTTP exception thrown: Snapshot 0dcb6d53-a013-4dac-8951-78919f31f4fe could not be found. Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7288b2a6-ae3e-4e07-a022-19697494b8ae tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Request method failure captured: Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe HTTP/1.1 Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8pi5d5kThZWZlCOEdLFZPePk58g7MZrYSKX5pK7CsY1Z7CJAKKxoK3_bXcuqJ-8T9fhOWnIv_MF5tYIthv9TpM2LAQ_RZvgAUN6gDhKAQuRs42M0FrhoqC_CDfr2hZSK66Ve8GkGkWzJfFtSDbbxeTy-z_YupKiSdxqVw7IzfSkvQE Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: d9dc686533584d00b764ff90330a6d0b Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1826387168 Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:21:19.270267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:21:19.271505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9dc686533584d00b764ff90330a6d0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9dc686533584d00b764ff90330a6d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9dc686533584d00b764ff90330a6d0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9dc686533584d00b764ff90330a6d0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:21:19.271505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1826387168 Sep 09 23:21:19.271505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: d9dc686533584d00b764ff90330a6d0b Sep 09 23:21:19.271505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1826387168 Sep 09 23:21:19.271505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-VolumesSnapshotsTestJSON-1826387168-project Sep 09 23:21:19.271505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:21:19.271505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:21:19.271505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: f29c9543ad85449cacc674d92fba578b Sep 09 23:21:19.271505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1826387168-project Sep 09 23:21:19.271505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: Sep 09 23:21:19.271505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Snapshot 0dcb6d53-a013-4dac-8951-78919f31f4fe could not be found. Sep 09 23:21:19.271505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '0dcb6d53-a013-4dac-8951-78919f31f4fe'} Sep 09 23:21:19.271505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0dcb6d53-a013-4dac-8951-78919f31f4fe could not be found. (HTTP 404) (Request-ID: req-dc6451f3-e29e-40ba-a497-d1eacf9ec27e) Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:21:19.272240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:21:19.273176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0dcb6d53-a013-4dac-8951-78919f31f4fe could not be found. Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 09 23:21:19.274110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:21:19.276945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0dcb6d53-a013-4dac-8951-78919f31f4fe could not be found. Sep 09 23:21:19.276945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:21:19.276945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:21:19.276945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:21:19.276945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:19.276945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:21:19.276945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:21:19.276945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:21:19.276945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:21:19.276945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0dcb6d53-a013-4dac-8951-78919f31f4fe could not be found. Sep 09 23:21:19.276945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:21:19.276945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7288b2a6-ae3e-4e07-a022-19697494b8ae tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Returning 404 to user: Snapshot 0dcb6d53-a013-4dac-8951-78919f31f4fe could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:21:19.276945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7288b2a6-ae3e-4e07-a022-19697494b8ae tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe" status: 404 len: 111 microversion: 2.1 time: 0.074263 Sep 09 23:21:19.281065 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-30649710-0b31-439d-8043-ede09eab9243 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908eb3ae50>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:19.292192 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 6/18] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 23:21:19 2022] GET /compute/v2.1/os-snapshots/0dcb6d53-a013-4dac-8951-78919f31f4fe => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:21:19.640444 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3fe1ca07-c60e-4f47-a7ba-ca4ec12a6c75 tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] Calling method '.version_select at 0x7f908e2518b0>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:19.714938 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-30649710-0b31-439d-8043-ede09eab9243 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/81d6984f-b01f-48ab-af9b-9723e19850db" status: 202 len: 0 microversion: 2.1 time: 0.438034 Sep 09 23:21:19.715835 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 13/19] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 23:21:19 2022] DELETE /compute/v2.1/os-volumes/81d6984f-b01f-48ab-af9b-9723e19850db => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 23:21:19.724873 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c9cf7272-c6eb-46e9-a658-34f292aefcc7 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908eb4b310>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:19.853286 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3fe1ca07-c60e-4f47-a7ba-ca4ec12a6c75 tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e11f71a1-46ff-49f8-9977-771381175015" status: 200 len: 351 microversion: 2.1 time: 0.216479 Sep 09 23:21:19.854396 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 7/20] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 23:21:19 2022] GET /compute/v2.1/os-volumes/e11f71a1-46ff-49f8-9977-771381175015 => generated 351 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:19.924962 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-c9cf7272-c6eb-46e9-a658-34f292aefcc7 tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/81d6984f-b01f-48ab-af9b-9723e19850db" status: 200 len: 344 microversion: 2.1 time: 0.204249 Sep 09 23:21:19.926833 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 14/21] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 23:21:19 2022] GET /compute/v2.1/os-volumes/81d6984f-b01f-48ab-af9b-9723e19850db => generated 344 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:19.931696 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0301395b-811c-4a52-8c84-2133d5890914 tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] Calling method '.version_select at 0x7f908eb4b940>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:20.089567 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-0301395b-811c-4a52-8c84-2133d5890914 tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.161278 Sep 09 23:21:20.090697 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 15/22] 10.222.0.20 () {58 vars in 1134 bytes} [Fri Sep 9 23:21:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:20.096775 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-6764d40f-dd85-445b-8baf-7ac80627e326 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:20.098576 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-6764d40f-dd85-445b-8baf-7ac80627e326 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:20.180206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-6764d40f-dd85-445b-8baf-7ac80627e326 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:20.193802 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-6764d40f-dd85-445b-8baf-7ac80627e326 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1215 microversion: 2.1 time: 0.096196 Sep 09 23:21:20.193802 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 16/23] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:20 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1215 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:20.229730 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-22d379d1-7c2c-4229-933b-7400280a6713 tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] Calling method '.version_select at 0x7f908eb4b9d0>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:20.341037 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1804364848", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:20.419765 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-22d379d1-7c2c-4229-933b-7400280a6713 tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.226838 Sep 09 23:21:20.424844 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 17/24] 10.222.0.20 () {58 vars in 1149 bytes} [Fri Sep 9 23:21:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:20.435301 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1a788721-2919-4ab8-98fd-7751ea4beaa4 tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] Calling method '.version_select at 0x7f908eb51a60>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:20.527782 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.network.neutron [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] validate_networks() for [('4076ec75-3b9f-4f28-96bf-84fd670013ed', None, None, None, None, None)] {{(pid=121058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:21:20.683008 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1a788721-2919-4ab8-98fd-7751ea4beaa4 tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.251513 Sep 09 23:21:20.683589 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 18/25] 10.222.0.20 () {58 vars in 1134 bytes} [Fri Sep 9 23:21:20 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:20.974673 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-cda3dba6-e2da-41f5-a0bf-1bda0f863fe3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Action: 'create', calling method: .version_select at 0x7f908f53b940>, body: {"keypair": {"name": "tempest-keypair-1411375985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ7q7qgaHPfQoKcM4KtucyGrCM4jIdsQ4KGKfEbRQEyAMhg+9ZUnscRlvBdXPAA6ocapkSSNTz+OURqt9/xw2IQ3y/OziwT2ENvdI7WWGcfko0keBL12jtZQpiO9wTZ1g=="}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:21.098417 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-cda3dba6-e2da-41f5-a0bf-1bda0f863fe3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Getting quotas for project 5c3517b03576446a902816ab0bbff2e7. Resources: {'key_pairs'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:21:21.113567 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-cda3dba6-e2da-41f5-a0bf-1bda0f863fe3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Getting quotas for user f097c4fc270748cc8d41d7bcaba672a7 and project 5c3517b03576446a902816ab0bbff2e7. Resources: {'key_pairs'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:21:21.357992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-cda3dba6-e2da-41f5-a0bf-1bda0f863fe3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.661320 Sep 09 23:21:21.359127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 19/26] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 23:21:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:21.375232 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-da5f4d0e-df53-4a57-8895-9077bfc05e1e tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] Calling method '.version_select at 0x7f908eb265e0>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:21.602814 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Flavor limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:21:21.603539 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Image limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:21:21.604116 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Flavor pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:21:21.604597 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Image pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:21:21.605011 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:21:21.636175 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:21.639044 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-da5f4d0e-df53-4a57-8895-9077bfc05e1e tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.278007 Sep 09 23:21:21.639555 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:21.646581 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:21.649815 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:21.652455 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:21.660937 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 20/27] 10.222.0.20 () {58 vars in 1167 bytes} [Fri Sep 9 23:21:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:21.661374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:21.664957 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-df5a80ae-fe07-42f6-925b-aa86b038e27e tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908ead5f70>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:21.734146 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Getting quotas for project 57759aec45f74a689727fca5fe201e40. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:21:21.749758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Getting quotas for user 987d2f6bb1ff4f1fa248c3ff410c8119 and project 57759aec45f74a689727fca5fe201e40. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:21:21.771607 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-df5a80ae-fe07-42f6-925b-aa86b038e27e tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] HTTP exception thrown: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-df5a80ae-fe07-42f6-925b-aa86b038e27e tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Request method failure captured: Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/os-volumes/81d6984f-b01f-48ab-af9b-9723e19850db HTTP/1.1 Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8pi5d5kThZWZlCOEdLFZPePk58g7MZrYSKX5pK7CsY1Z7CJAKKxoK3_bXcuqJ-8T9fhOWnIv_MF5tYIthv9TpM2LAQ_RZvgAUN6gDhKAQuRs42M0FrhoqC_CDfr2hZSK66Ve8GkGkWzJfFtSDbbxeTy-z_YupKiSdxqVw7IzfSkvQE Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: d9dc686533584d00b764ff90330a6d0b Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1826387168 Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:21:21.777184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:21:21.778550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9dc686533584d00b764ff90330a6d0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9dc686533584d00b764ff90330a6d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9dc686533584d00b764ff90330a6d0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9dc686533584d00b764ff90330a6d0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:21:21.778550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1826387168 Sep 09 23:21:21.778550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: d9dc686533584d00b764ff90330a6d0b Sep 09 23:21:21.778550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1826387168 Sep 09 23:21:21.778550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-VolumesSnapshotsTestJSON-1826387168-project Sep 09 23:21:21.778550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:21:21.778550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:21:21.778550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: f29c9543ad85449cacc674d92fba578b Sep 09 23:21:21.778550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1826387168-project Sep 09 23:21:21.778550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: Sep 09 23:21:21.778550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. Sep 09 23:21:21.778550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '81d6984f-b01f-48ab-af9b-9723e19850db'} Sep 09 23:21:21.778550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. (HTTP 404) (Request-ID: req-31ae0a41-8321-4016-9989-3831f8ea1b31) Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:21:21.779331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:21:21.780579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 23:21:21.782294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:21:21.783530 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. Sep 09 23:21:21.783530 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:21.783530 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:21:21.783530 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:21.783530 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:21.783530 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:21:21.783530 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:21:21.783530 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:21:21.783530 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:21:21.783530 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. Sep 09 23:21:21.783530 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:21.786264 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-df5a80ae-fe07-42f6-925b-aa86b038e27e tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Returning 404 to user: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:21:21.787494 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-df5a80ae-fe07-42f6-925b-aa86b038e27e tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/81d6984f-b01f-48ab-af9b-9723e19850db" status: 404 len: 109 microversion: 2.1 time: 0.132222 Sep 09 23:21:21.790647 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 21/28] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 23:21:21 2022] GET /compute/v2.1/os-volumes/81d6984f-b01f-48ab-af9b-9723e19850db => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:21:21.794120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-10774cde-9e01-43e8-9c2f-087565d982af tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:21.794996 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-10774cde-9e01-43e8-9c2f-087565d982af tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:21.807411 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Going to run 1 instances... {{(pid=121058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:21:21.809877 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-10774cde-9e01-43e8-9c2f-087565d982af tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:21.810236 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:21:21.810736 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-10774cde-9e01-43e8-9c2f-087565d982af tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:21.811185 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-10774cde-9e01-43e8-9c2f-087565d982af tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:21.811899 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-10774cde-9e01-43e8-9c2f-087565d982af tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:21.812555 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-10774cde-9e01-43e8-9c2f-087565d982af tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:21.813054 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-10774cde-9e01-43e8-9c2f-087565d982af tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:21.996336 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a2288a89-96bc-4647-af23-80b60f01f201 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.134532 Sep 09 23:21:21.997356 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 8/29] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:21:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:21:22.004539 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7343513a-bb77-4077-a80a-b88b1f79d35a tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] Calling method '.version_select at 0x7f908e26adc0>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:22.230255 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-10774cde-9e01-43e8-9c2f-087565d982af tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:22.257991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-10774cde-9e01-43e8-9c2f-087565d982af tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1219 microversion: 2.1 time: 0.468039 Sep 09 23:21:22.266109 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 22/30] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:21 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1219 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:22.284248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ca9f5fdc-c2ec-44cd-bf90-2c7b174d93ce tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908e9bb280>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:22.320792 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7343513a-bb77-4077-a80a-b88b1f79d35a tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.322183 Sep 09 23:21:22.335616 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 9/31] 10.222.0.20 () {58 vars in 1170 bytes} [Fri Sep 9 23:21:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:22.340862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9d1b5188-d4d2-4ac8-886f-a1a100a89f59 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:22.341513 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9d1b5188-d4d2-4ac8-886f-a1a100a89f59 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:22.343971 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-ca9f5fdc-c2ec-44cd-bf90-2c7b174d93ce tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] HTTP exception thrown: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ca9f5fdc-c2ec-44cd-bf90-2c7b174d93ce tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Request method failure captured: Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: DELETE /compute/v2.1/os-volumes/81d6984f-b01f-48ab-af9b-9723e19850db HTTP/1.1 Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8pi5d5kThZWZlCOEdLFZPePk58g7MZrYSKX5pK7CsY1Z7CJAKKxoK3_bXcuqJ-8T9fhOWnIv_MF5tYIthv9TpM2LAQ_RZvgAUN6gDhKAQuRs42M0FrhoqC_CDfr2hZSK66Ve8GkGkWzJfFtSDbbxeTy-z_YupKiSdxqVw7IzfSkvQE Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: d9dc686533584d00b764ff90330a6d0b Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1826387168 Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:21:22.358096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:21:22.359272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9dc686533584d00b764ff90330a6d0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9dc686533584d00b764ff90330a6d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9dc686533584d00b764ff90330a6d0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9dc686533584d00b764ff90330a6d0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:21:22.359272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1826387168 Sep 09 23:21:22.359272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: d9dc686533584d00b764ff90330a6d0b Sep 09 23:21:22.359272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1826387168 Sep 09 23:21:22.359272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-VolumesSnapshotsTestJSON-1826387168-project Sep 09 23:21:22.359272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:21:22.359272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:21:22.359272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: f29c9543ad85449cacc674d92fba578b Sep 09 23:21:22.359272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1826387168-project Sep 09 23:21:22.359272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: Sep 09 23:21:22.359272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. Sep 09 23:21:22.359272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '81d6984f-b01f-48ab-af9b-9723e19850db'} Sep 09 23:21:22.359272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. (HTTP 404) (Request-ID: req-f2c7df40-e4ad-4dfb-b1a2-75437562b463) Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:21:22.360524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 23:21:22.362210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 23:21:22.364393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:21:22.366652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. Sep 09 23:21:22.366652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:22.366652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:21:22.366652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:22.366652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:22.366652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:21:22.366652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:21:22.366652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:21:22.366652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:21:22.366652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. Sep 09 23:21:22.366652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:22.366652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ca9f5fdc-c2ec-44cd-bf90-2c7b174d93ce tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Returning 404 to user: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:21:22.366652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ca9f5fdc-c2ec-44cd-bf90-2c7b174d93ce tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/81d6984f-b01f-48ab-af9b-9723e19850db" status: 404 len: 109 microversion: 2.1 time: 0.092193 Sep 09 23:21:22.371223 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 23/32] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 23:21:22 2022] DELETE /compute/v2.1/os-volumes/81d6984f-b01f-48ab-af9b-9723e19850db => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:21:22.393212 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-77265a54-21e4-4e01-ae28-3547afbdfdc0 tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] Calling method '.version_select at 0x7f908ea2a9d0>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:22.587105 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-77265a54-21e4-4e01-ae28-3547afbdfdc0 tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.214210 Sep 09 23:21:22.588053 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 24/33] 10.222.0.20 () {58 vars in 1155 bytes} [Fri Sep 9 23:21:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:22.599082 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d921e560-da00-45f4-99b4-6dfa6712ed1f tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Calling method '.version_select at 0x7f908e9c8700>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:22.668683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-d921e560-da00-45f4-99b4-6dfa6712ed1f tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] HTTP exception thrown: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d921e560-da00-45f4-99b4-6dfa6712ed1f tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Request method failure captured: Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/os-volumes/81d6984f-b01f-48ab-af9b-9723e19850db HTTP/1.1 Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8pi5d5kThZWZlCOEdLFZPePk58g7MZrYSKX5pK7CsY1Z7CJAKKxoK3_bXcuqJ-8T9fhOWnIv_MF5tYIthv9TpM2LAQ_RZvgAUN6gDhKAQuRs42M0FrhoqC_CDfr2hZSK66Ve8GkGkWzJfFtSDbbxeTy-z_YupKiSdxqVw7IzfSkvQE Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: d9dc686533584d00b764ff90330a6d0b Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1826387168 Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:21:22.671630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:21:22.673343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9dc686533584d00b764ff90330a6d0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9dc686533584d00b764ff90330a6d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9dc686533584d00b764ff90330a6d0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9dc686533584d00b764ff90330a6d0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:21:22.673343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1826387168 Sep 09 23:21:22.673343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: d9dc686533584d00b764ff90330a6d0b Sep 09 23:21:22.673343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1826387168 Sep 09 23:21:22.673343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-VolumesSnapshotsTestJSON-1826387168-project Sep 09 23:21:22.673343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:21:22.673343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:21:22.673343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: f29c9543ad85449cacc674d92fba578b Sep 09 23:21:22.673343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1826387168-project Sep 09 23:21:22.673343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: Sep 09 23:21:22.673343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. Sep 09 23:21:22.673343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '81d6984f-b01f-48ab-af9b-9723e19850db'} Sep 09 23:21:22.673343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. (HTTP 404) (Request-ID: req-495e1c80-128a-4453-ad01-1b9fba638870) Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:21:22.673975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:21:22.674924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 23:21:22.675875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:21:22.678077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. Sep 09 23:21:22.678077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:22.678077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:21:22.678077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:22.678077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:21:22.678077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:21:22.678077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:21:22.678077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:21:22.678077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:21:22.678077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. Sep 09 23:21:22.678077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:21:22.678077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d921e560-da00-45f4-99b4-6dfa6712ed1f tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] Returning 404 to user: Volume 81d6984f-b01f-48ab-af9b-9723e19850db could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:21:22.678077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d921e560-da00-45f4-99b4-6dfa6712ed1f tempest-VolumesSnapshotsTestJSON-1826387168 tempest-VolumesSnapshotsTestJSON-1826387168-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/81d6984f-b01f-48ab-af9b-9723e19850db" status: 404 len: 109 microversion: 2.1 time: 0.085228 Sep 09 23:21:22.678077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 25/34] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 23:21:22 2022] GET /compute/v2.1/os-volumes/81d6984f-b01f-48ab-af9b-9723e19850db => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:21:22.710074 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-18463079-ce0d-4e1d-a475-dfedec0088e5 tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] Calling method '.version_select at 0x7f908e9bbd30>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:22.887457 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9d1b5188-d4d2-4ac8-886f-a1a100a89f59 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:22.953247 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-18463079-ce0d-4e1d-a475-dfedec0088e5 tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.276708 Sep 09 23:21:22.955071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 26/35] 10.222.0.20 () {58 vars in 1188 bytes} [Fri Sep 9 23:21:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:22.960729 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9d1b5188-d4d2-4ac8-886f-a1a100a89f59 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1222 microversion: 2.1 time: 0.622135 Sep 09 23:21:22.962530 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 10/36] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:22 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1222 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:22.973815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-45d87ff4-6b70-4940-81cb-2e4d3c2cfbcf tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] Calling method '.version_select at 0x7f908e9c88b0>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:23.108735 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-45d87ff4-6b70-4940-81cb-2e4d3c2cfbcf tempest-VolumesTestJSON-2011117464 tempest-VolumesTestJSON-2011117464-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.141182 Sep 09 23:21:23.110124 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 27/37] 10.222.0.20 () {58 vars in 1155 bytes} [Fri Sep 9 23:21:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:23.294960 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-80ff9ee1-5721-4122-98bc-b11a6a706415 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:23.295929 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-80ff9ee1-5721-4122-98bc-b11a6a706415 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:23.310146 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-80ff9ee1-5721-4122-98bc-b11a6a706415 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:23.311151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-80ff9ee1-5721-4122-98bc-b11a6a706415 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:23.311804 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-80ff9ee1-5721-4122-98bc-b11a6a706415 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:23.313369 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-80ff9ee1-5721-4122-98bc-b11a6a706415 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:23.314148 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-80ff9ee1-5721-4122-98bc-b11a6a706415 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:23.314840 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-80ff9ee1-5721-4122-98bc-b11a6a706415 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:23.553759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1174461982", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:23.589941 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-80ff9ee1-5721-4122-98bc-b11a6a706415 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:23.618938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-80ff9ee1-5721-4122-98bc-b11a6a706415 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1267 microversion: 2.1 time: 0.329771 Sep 09 23:21:23.618938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 11/38] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:23 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1267 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:23.748329 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.network.neutron [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] validate_networks() for [('4076ec75-3b9f-4f28-96bf-84fd670013ed', None, None, None, None, None)] {{(pid=121059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:21:24.650573 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-bca1662a-e28f-404e-b716-3c2470b0eeeb tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:24.651290 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-bca1662a-e28f-404e-b716-3c2470b0eeeb tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:24.666252 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bca1662a-e28f-404e-b716-3c2470b0eeeb tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:24.667754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bca1662a-e28f-404e-b716-3c2470b0eeeb tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:24.668216 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bca1662a-e28f-404e-b716-3c2470b0eeeb tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:24.670143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bca1662a-e28f-404e-b716-3c2470b0eeeb tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:24.672061 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bca1662a-e28f-404e-b716-3c2470b0eeeb tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:24.677591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bca1662a-e28f-404e-b716-3c2470b0eeeb tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:25.025321 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bca1662a-e28f-404e-b716-3c2470b0eeeb tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:25.035631 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-bca1662a-e28f-404e-b716-3c2470b0eeeb tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1285 microversion: 2.1 time: 0.390689 Sep 09 23:21:25.054443 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 12/39] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:24 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1285 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:25.450676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Flavor limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:21:25.453244 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Image limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:21:25.454844 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Flavor pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:21:25.456249 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Image pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:21:25.457302 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:21:25.480688 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:25.481946 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:25.482639 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:25.483893 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:25.484572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:25.486024 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:25.523971 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Getting quotas for project 57759aec45f74a689727fca5fe201e40. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:21:25.535716 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Getting quotas for user 987d2f6bb1ff4f1fa248c3ff410c8119 and project 57759aec45f74a689727fca5fe201e40. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:21:25.590332 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Going to run 1 instances... {{(pid=121059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:21:25.596426 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:21:25.953763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ebbd912f-2276-4ce1-83cb-0d311db8bd73 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.406695 Sep 09 23:21:25.961468 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 28/40] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:21:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 23:21:25.997949 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-85535e3c-bc2f-4b2d-8788-26ac112f70bc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:25.999099 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-85535e3c-bc2f-4b2d-8788-26ac112f70bc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:26.083778 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d6bf8ff9-dc35-4b3c-9003-b8ec3444fc25 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:26.084728 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d6bf8ff9-dc35-4b3c-9003-b8ec3444fc25 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:26.096391 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d6bf8ff9-dc35-4b3c-9003-b8ec3444fc25 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:26.097160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d6bf8ff9-dc35-4b3c-9003-b8ec3444fc25 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:26.098450 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d6bf8ff9-dc35-4b3c-9003-b8ec3444fc25 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:26.102560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d6bf8ff9-dc35-4b3c-9003-b8ec3444fc25 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:26.102560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d6bf8ff9-dc35-4b3c-9003-b8ec3444fc25 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:26.102560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d6bf8ff9-dc35-4b3c-9003-b8ec3444fc25 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:26.197714 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-85535e3c-bc2f-4b2d-8788-26ac112f70bc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:26.209231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-85535e3c-bc2f-4b2d-8788-26ac112f70bc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1222 microversion: 2.1 time: 0.214258 Sep 09 23:21:26.211774 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 13/41] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:25 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1222 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:26.320871 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d6bf8ff9-dc35-4b3c-9003-b8ec3444fc25 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:26.332355 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d6bf8ff9-dc35-4b3c-9003-b8ec3444fc25 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1273 microversion: 2.1 time: 0.254439 Sep 09 23:21:26.345339 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 29/42] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:26 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:21:27.245909 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-12117e37-e3c0-47a8-9b95-4151ef9617be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:27.262135 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-12117e37-e3c0-47a8-9b95-4151ef9617be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:27.385465 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-715832b9-3af5-4045-b2c9-b570199a25ca tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:27.385465 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-715832b9-3af5-4045-b2c9-b570199a25ca tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:27.443131 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-715832b9-3af5-4045-b2c9-b570199a25ca tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:27.448381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-715832b9-3af5-4045-b2c9-b570199a25ca tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:27.456774 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-715832b9-3af5-4045-b2c9-b570199a25ca tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:27.457690 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-715832b9-3af5-4045-b2c9-b570199a25ca tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:27.458209 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-715832b9-3af5-4045-b2c9-b570199a25ca tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:27.458786 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-715832b9-3af5-4045-b2c9-b570199a25ca tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:27.710605 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-12117e37-e3c0-47a8-9b95-4151ef9617be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:27.745714 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-12117e37-e3c0-47a8-9b95-4151ef9617be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1222 microversion: 2.1 time: 0.507744 Sep 09 23:21:27.752666 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 14/43] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:27 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1222 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:27.939702 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-715832b9-3af5-4045-b2c9-b570199a25ca tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:27.954910 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-715832b9-3af5-4045-b2c9-b570199a25ca tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1273 microversion: 2.1 time: 0.592300 Sep 09 23:21:27.966716 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 30/44] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:27 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1273 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:21:28.775774 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8b199ccf-39a9-4796-88cc-085b8e962f0f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:28.777063 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8b199ccf-39a9-4796-88cc-085b8e962f0f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:28.785844 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8b199ccf-39a9-4796-88cc-085b8e962f0f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:28.787701 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8b199ccf-39a9-4796-88cc-085b8e962f0f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:28.787701 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8b199ccf-39a9-4796-88cc-085b8e962f0f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:28.791537 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8b199ccf-39a9-4796-88cc-085b8e962f0f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:28.792289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8b199ccf-39a9-4796-88cc-085b8e962f0f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:28.793317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8b199ccf-39a9-4796-88cc-085b8e962f0f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:28.990807 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4e9b0521-28f7-42cf-9704-62eadca43fe6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:28.990807 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4e9b0521-28f7-42cf-9704-62eadca43fe6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:29.003464 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4e9b0521-28f7-42cf-9704-62eadca43fe6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:29.003971 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4e9b0521-28f7-42cf-9704-62eadca43fe6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:29.004421 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4e9b0521-28f7-42cf-9704-62eadca43fe6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:29.005151 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4e9b0521-28f7-42cf-9704-62eadca43fe6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:29.005616 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4e9b0521-28f7-42cf-9704-62eadca43fe6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:29.006046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4e9b0521-28f7-42cf-9704-62eadca43fe6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:29.176686 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8b199ccf-39a9-4796-88cc-085b8e962f0f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:29.195199 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8b199ccf-39a9-4796-88cc-085b8e962f0f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1218 microversion: 2.1 time: 0.424051 Sep 09 23:21:29.215086 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 15/45] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:28 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1218 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:29.527249 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4e9b0521-28f7-42cf-9704-62eadca43fe6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:29.537225 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4e9b0521-28f7-42cf-9704-62eadca43fe6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.553550 Sep 09 23:21:29.538983 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 31/46] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:28 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:29.622025 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1042669616", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "471c0a9c-07f4-4630-8d7a-4695d6b4f22d"}], "security_groups": [{"name": "tempest-securitygroup--845788988"}], "key_name": "tempest-keypair-1411375985", "user_data": "}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:29.879351 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.network.neutron [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] validate_networks() for [('471c0a9c-07f4-4630-8d7a-4695d6b4f22d', None, None, None, None, None)] {{(pid=121058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:21:30.241905 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-38a57b39-c2e5-467f-bfbf-b9d84d021f8e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:30.241905 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-38a57b39-c2e5-467f-bfbf-b9d84d021f8e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:30.261131 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-38a57b39-c2e5-467f-bfbf-b9d84d021f8e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:30.264891 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-38a57b39-c2e5-467f-bfbf-b9d84d021f8e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:30.266589 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-38a57b39-c2e5-467f-bfbf-b9d84d021f8e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:30.272327 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-38a57b39-c2e5-467f-bfbf-b9d84d021f8e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:30.273645 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-38a57b39-c2e5-467f-bfbf-b9d84d021f8e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:30.277278 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-38a57b39-c2e5-467f-bfbf-b9d84d021f8e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:30.607613 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-38a57b39-c2e5-467f-bfbf-b9d84d021f8e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:30.621138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-38a57b39-c2e5-467f-bfbf-b9d84d021f8e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1274 microversion: 2.1 time: 0.387983 Sep 09 23:21:30.641745 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 32/47] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:30 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1274 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:30.660071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-96d833c2-a1d1-4442-9fcf-2cf48492c0b9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:30.663353 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-96d833c2-a1d1-4442-9fcf-2cf48492c0b9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:30.687360 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-96d833c2-a1d1-4442-9fcf-2cf48492c0b9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:30.687360 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-96d833c2-a1d1-4442-9fcf-2cf48492c0b9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:30.687360 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-96d833c2-a1d1-4442-9fcf-2cf48492c0b9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:30.687360 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-96d833c2-a1d1-4442-9fcf-2cf48492c0b9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:30.690329 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-96d833c2-a1d1-4442-9fcf-2cf48492c0b9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:30.690937 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-96d833c2-a1d1-4442-9fcf-2cf48492c0b9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:31.348977 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-96d833c2-a1d1-4442-9fcf-2cf48492c0b9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:31.361799 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-96d833c2-a1d1-4442-9fcf-2cf48492c0b9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.715886 Sep 09 23:21:31.364516 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 33/48] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:30 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:31.658439 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5d243872-9ddc-4b76-bec7-df92af8b3c52 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:31.658439 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5d243872-9ddc-4b76-bec7-df92af8b3c52 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:31.658439 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d243872-9ddc-4b76-bec7-df92af8b3c52 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:31.673486 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d243872-9ddc-4b76-bec7-df92af8b3c52 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:31.673486 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d243872-9ddc-4b76-bec7-df92af8b3c52 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:31.673486 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d243872-9ddc-4b76-bec7-df92af8b3c52 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:31.673486 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d243872-9ddc-4b76-bec7-df92af8b3c52 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:31.674436 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d243872-9ddc-4b76-bec7-df92af8b3c52 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:31.675895 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=4 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:31.926473 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5d243872-9ddc-4b76-bec7-df92af8b3c52 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:31.945899 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5d243872-9ddc-4b76-bec7-df92af8b3c52 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1280 microversion: 2.1 time: 0.304501 Sep 09 23:21:31.951441 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 34/49] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:31 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1280 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:21:32.397370 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1b8ce824-ab26-4431-a78f-9d93be883eb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:32.399532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1b8ce824-ab26-4431-a78f-9d93be883eb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:32.415661 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1b8ce824-ab26-4431-a78f-9d93be883eb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:32.416166 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1b8ce824-ab26-4431-a78f-9d93be883eb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:32.416642 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1b8ce824-ab26-4431-a78f-9d93be883eb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:32.425925 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1b8ce824-ab26-4431-a78f-9d93be883eb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:32.427030 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1b8ce824-ab26-4431-a78f-9d93be883eb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:32.432638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1b8ce824-ab26-4431-a78f-9d93be883eb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:32.482547 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Flavor limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:21:32.482547 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Image limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:21:32.482547 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Flavor pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:21:32.482547 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Image pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:21:32.482961 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:21:32.498602 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:32.499088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:32.499809 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:32.516470 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:32.524325 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:32.527402 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:32.602336 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Getting quotas for project 5c3517b03576446a902816ab0bbff2e7. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:21:32.615867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Getting quotas for user f097c4fc270748cc8d41d7bcaba672a7 and project 5c3517b03576446a902816ab0bbff2e7. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:21:32.650093 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Going to run 1 instances... {{(pid=121058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:21:32.652477 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:21:33.021774 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-097040b1-c039-4041-b3e4-58adfd0b1d53 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.405048 Sep 09 23:21:33.028897 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 16/50] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:21:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 3411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:21:33.049558 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8ab598d5-e5c0-4832-ba74-7c20f5a774d4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:33.050232 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8ab598d5-e5c0-4832-ba74-7c20f5a774d4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:33.073611 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ab598d5-e5c0-4832-ba74-7c20f5a774d4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:33.075496 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ab598d5-e5c0-4832-ba74-7c20f5a774d4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:33.076781 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ab598d5-e5c0-4832-ba74-7c20f5a774d4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:33.077710 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ab598d5-e5c0-4832-ba74-7c20f5a774d4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:33.081043 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ab598d5-e5c0-4832-ba74-7c20f5a774d4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:33.081672 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ab598d5-e5c0-4832-ba74-7c20f5a774d4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:33.215899 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1b8ce824-ab26-4431-a78f-9d93be883eb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:33.221694 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1b8ce824-ab26-4431-a78f-9d93be883eb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.828336 Sep 09 23:21:33.226460 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 35/51] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:32 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:33.239183 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ed5b3393-d42d-4fa4-817a-e456f8e2cc2d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:33.239802 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ed5b3393-d42d-4fa4-817a-e456f8e2cc2d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:33.464690 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ed5b3393-d42d-4fa4-817a-e456f8e2cc2d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:33.479325 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ed5b3393-d42d-4fa4-817a-e456f8e2cc2d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1238 microversion: 2.1 time: 0.248580 Sep 09 23:21:33.482819 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 36/52] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:33 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1238 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:33.665112 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8ab598d5-e5c0-4832-ba74-7c20f5a774d4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:33.672565 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8ab598d5-e5c0-4832-ba74-7c20f5a774d4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1280 microversion: 2.1 time: 0.643912 Sep 09 23:21:33.675458 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 17/53] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:33 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1280 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:34.251881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-060f9208-0ab8-44d1-97d1-eb5190d82fb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:34.252608 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-060f9208-0ab8-44d1-97d1-eb5190d82fb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:34.265511 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-060f9208-0ab8-44d1-97d1-eb5190d82fb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:34.269541 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-060f9208-0ab8-44d1-97d1-eb5190d82fb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:34.270445 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-060f9208-0ab8-44d1-97d1-eb5190d82fb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:34.276659 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-060f9208-0ab8-44d1-97d1-eb5190d82fb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:34.277403 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-060f9208-0ab8-44d1-97d1-eb5190d82fb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:34.278068 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-060f9208-0ab8-44d1-97d1-eb5190d82fb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:34.518301 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-d535ea13-3350-47ab-a289-e4532d510465 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:34.520748 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-d535ea13-3350-47ab-a289-e4532d510465 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:34.857742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-060f9208-0ab8-44d1-97d1-eb5190d82fb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:34.866924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-060f9208-0ab8-44d1-97d1-eb5190d82fb9 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.623044 Sep 09 23:21:34.867495 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 37/54] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:34 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:34.970768 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d535ea13-3350-47ab-a289-e4532d510465 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:34.993435 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-d535ea13-3350-47ab-a289-e4532d510465 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1238 microversion: 2.1 time: 0.476435 Sep 09 23:21:35.024599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 18/55] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:34 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1238 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:21:35.041270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1a4d19a4-2cbf-472d-abf3-4e1bdfca0a36 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:35.045326 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-1a4d19a4-2cbf-472d-abf3-4e1bdfca0a36 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:35.049187 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-27c0da14-0ce5-49a1-b07b-67584af2d643 req-b37f688d-f57b-4d8d-a4ba-c1a1a09719c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b8a715-050b-4cbd-aff9-747f65d1e8b5", "tag": "9a2bd38a-1f80-486d-8e11-48bf4e66c96d"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:35.064927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1a4d19a4-2cbf-472d-abf3-4e1bdfca0a36 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:35.067693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1a4d19a4-2cbf-472d-abf3-4e1bdfca0a36 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:35.070994 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1a4d19a4-2cbf-472d-abf3-4e1bdfca0a36 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:35.070994 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1a4d19a4-2cbf-472d-abf3-4e1bdfca0a36 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:35.070994 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1a4d19a4-2cbf-472d-abf3-4e1bdfca0a36 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:35.073157 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1a4d19a4-2cbf-472d-abf3-4e1bdfca0a36 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:35.089048 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-27c0da14-0ce5-49a1-b07b-67584af2d643 req-b37f688d-f57b-4d8d-a4ba-c1a1a09719c0 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:35.089544 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-27c0da14-0ce5-49a1-b07b-67584af2d643 req-b37f688d-f57b-4d8d-a4ba-c1a1a09719c0 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:35.089983 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-27c0da14-0ce5-49a1-b07b-67584af2d643 req-b37f688d-f57b-4d8d-a4ba-c1a1a09719c0 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:35.176008 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-27c0da14-0ce5-49a1-b07b-67584af2d643 req-b37f688d-f57b-4d8d-a4ba-c1a1a09719c0 service nova] Creating event network-changed:9a2bd38a-1f80-486d-8e11-48bf4e66c96d for instance e2b8a715-050b-4cbd-aff9-747f65d1e8b5 on hv-cinder-85032 Sep 09 23:21:35.176553 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-27c0da14-0ce5-49a1-b07b-67584af2d643 req-b37f688d-f57b-4d8d-a4ba-c1a1a09719c0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 23:21:35.176943 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-27c0da14-0ce5-49a1-b07b-67584af2d643 req-b37f688d-f57b-4d8d-a4ba-c1a1a09719c0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 23:21:35.178080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-139ed9d5-9b82-4efe-9271-fb459a1e9494 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:35.178650 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-139ed9d5-9b82-4efe-9271-fb459a1e9494 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:35.179085 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-139ed9d5-9b82-4efe-9271-fb459a1e9494 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:35.179804 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-139ed9d5-9b82-4efe-9271-fb459a1e9494 None None] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:35.180252 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-139ed9d5-9b82-4efe-9271-fb459a1e9494 None None] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:35.180667 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-139ed9d5-9b82-4efe-9271-fb459a1e9494 None None] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:35.233080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.compute.rpcapi [None req-139ed9d5-9b82-4efe-9271-fb459a1e9494 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 23:21:35.234099 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-139ed9d5-9b82-4efe-9271-fb459a1e9494 None None] Releasing lock "compute-rpcapi-router" {{(pid=121059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 23:21:35.278806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-139ed9d5-9b82-4efe-9271-fb459a1e9494 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.408883 Sep 09 23:21:35.278806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 38/56] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:35.940233 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1a4d19a4-2cbf-472d-abf3-4e1bdfca0a36 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:35.940233 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-1a4d19a4-2cbf-472d-abf3-4e1bdfca0a36 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1322 microversion: 2.1 time: 0.912816 Sep 09 23:21:35.941581 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 19/57] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:35 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1322 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:35.946122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-eb4d7210-ddd3-4f8b-bbd6-5ae86d50cf30 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:35.946913 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-eb4d7210-ddd3-4f8b-bbd6-5ae86d50cf30 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:35.969453 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-22ab9575-baf7-4f08-a11a-bd019038b22a req-d723c5c6-e942-4a98-8c2d-680804b552e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98941a2f-f38e-401c-952d-0306b886414b", "tag": "68303a0a-a147-4bf7-bc4c-c100d86bdfbb"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:35.983336 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eb4d7210-ddd3-4f8b-bbd6-5ae86d50cf30 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:35.983852 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eb4d7210-ddd3-4f8b-bbd6-5ae86d50cf30 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:35.984415 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eb4d7210-ddd3-4f8b-bbd6-5ae86d50cf30 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:35.991090 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-22ab9575-baf7-4f08-a11a-bd019038b22a req-d723c5c6-e942-4a98-8c2d-680804b552e6 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:35.991906 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-22ab9575-baf7-4f08-a11a-bd019038b22a req-d723c5c6-e942-4a98-8c2d-680804b552e6 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:35.992607 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-22ab9575-baf7-4f08-a11a-bd019038b22a req-d723c5c6-e942-4a98-8c2d-680804b552e6 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:35.998178 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eb4d7210-ddd3-4f8b-bbd6-5ae86d50cf30 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:35.999806 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eb4d7210-ddd3-4f8b-bbd6-5ae86d50cf30 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:36.005709 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eb4d7210-ddd3-4f8b-bbd6-5ae86d50cf30 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:36.020790 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-22ab9575-baf7-4f08-a11a-bd019038b22a req-d723c5c6-e942-4a98-8c2d-680804b552e6 service nova] Creating event network-changed:68303a0a-a147-4bf7-bc4c-c100d86bdfbb for instance 98941a2f-f38e-401c-952d-0306b886414b on hv-cinder-85032 Sep 09 23:21:36.030146 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-22ab9575-baf7-4f08-a11a-bd019038b22a req-d723c5c6-e942-4a98-8c2d-680804b552e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.571043 Sep 09 23:21:36.033302 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 39/58] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:21:36.045851 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4e1a37b5-4263-420c-b13c-7c1e2ae25671 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:36.046597 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4e1a37b5-4263-420c-b13c-7c1e2ae25671 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:36.065096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4e1a37b5-4263-420c-b13c-7c1e2ae25671 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:36.065606 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4e1a37b5-4263-420c-b13c-7c1e2ae25671 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:36.066057 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4e1a37b5-4263-420c-b13c-7c1e2ae25671 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:36.069085 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4e1a37b5-4263-420c-b13c-7c1e2ae25671 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:36.069442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4e1a37b5-4263-420c-b13c-7c1e2ae25671 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:36.071443 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4e1a37b5-4263-420c-b13c-7c1e2ae25671 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:36.268905 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4e1a37b5-4263-420c-b13c-7c1e2ae25671 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:36.277105 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4e1a37b5-4263-420c-b13c-7c1e2ae25671 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1242 microversion: 2.1 time: 0.235712 Sep 09 23:21:36.286652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 40/59] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:36 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1242 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:36.495769 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-eb4d7210-ddd3-4f8b-bbd6-5ae86d50cf30 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:36.512713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-eb4d7210-ddd3-4f8b-bbd6-5ae86d50cf30 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.571194 Sep 09 23:21:36.523029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 20/60] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:35 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:36.982620 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-39874b5c-b86c-451d-b839-e265bfac3a62 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:36.985403 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-39874b5c-b86c-451d-b839-e265bfac3a62 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:36.997151 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-39874b5c-b86c-451d-b839-e265bfac3a62 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:36.997742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-39874b5c-b86c-451d-b839-e265bfac3a62 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:36.998205 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-39874b5c-b86c-451d-b839-e265bfac3a62 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:37.001053 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-39874b5c-b86c-451d-b839-e265bfac3a62 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:37.004020 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-39874b5c-b86c-451d-b839-e265bfac3a62 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:37.005471 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-39874b5c-b86c-451d-b839-e265bfac3a62 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:37.307376 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-59462c95-2107-4eff-b197-8e4ecfbe7107 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:37.308779 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-59462c95-2107-4eff-b197-8e4ecfbe7107 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:37.317818 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-59462c95-2107-4eff-b197-8e4ecfbe7107 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:37.318609 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-59462c95-2107-4eff-b197-8e4ecfbe7107 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:37.319312 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-59462c95-2107-4eff-b197-8e4ecfbe7107 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:37.320499 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-59462c95-2107-4eff-b197-8e4ecfbe7107 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:37.321220 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-59462c95-2107-4eff-b197-8e4ecfbe7107 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:37.321908 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-59462c95-2107-4eff-b197-8e4ecfbe7107 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:37.650411 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-39874b5c-b86c-451d-b839-e265bfac3a62 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:37.682419 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-39874b5c-b86c-451d-b839-e265bfac3a62 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1322 microversion: 2.1 time: 0.703123 Sep 09 23:21:37.683048 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 41/61] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:36 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1322 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:37.724035 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-44ffbc6c-b955-42cc-bcbf-ff91d3a93313 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:37.725687 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-44ffbc6c-b955-42cc-bcbf-ff91d3a93313 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:37.738546 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-59462c95-2107-4eff-b197-8e4ecfbe7107 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:37.746419 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-44ffbc6c-b955-42cc-bcbf-ff91d3a93313 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:37.748790 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-59462c95-2107-4eff-b197-8e4ecfbe7107 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1290 microversion: 2.1 time: 0.445536 Sep 09 23:21:37.749945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 21/62] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:37 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1290 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:37.757969 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-44ffbc6c-b955-42cc-bcbf-ff91d3a93313 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:37.758831 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-44ffbc6c-b955-42cc-bcbf-ff91d3a93313 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:37.759776 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-44ffbc6c-b955-42cc-bcbf-ff91d3a93313 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:37.762040 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-44ffbc6c-b955-42cc-bcbf-ff91d3a93313 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:37.762626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-44ffbc6c-b955-42cc-bcbf-ff91d3a93313 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:38.032275 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-44ffbc6c-b955-42cc-bcbf-ff91d3a93313 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:38.046121 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-44ffbc6c-b955-42cc-bcbf-ff91d3a93313 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.358671 Sep 09 23:21:38.050025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 42/63] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:37 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:38.075590 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-c0d810ee-74a0-4451-ad83-3b25767d7259 req-01c1993f-9b44-4b1e-b497-16445d010bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a719e8e5-c9aa-4e96-ba41-eae5881e5b06", "tag": "2128df64-e397-4a56-8627-d374cf1333e3"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:38.091913 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c0d810ee-74a0-4451-ad83-3b25767d7259 req-01c1993f-9b44-4b1e-b497-16445d010bbf service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:38.093202 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c0d810ee-74a0-4451-ad83-3b25767d7259 req-01c1993f-9b44-4b1e-b497-16445d010bbf service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:38.093847 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c0d810ee-74a0-4451-ad83-3b25767d7259 req-01c1993f-9b44-4b1e-b497-16445d010bbf service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:38.120477 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-c0d810ee-74a0-4451-ad83-3b25767d7259 req-01c1993f-9b44-4b1e-b497-16445d010bbf service nova] Creating event network-changed:2128df64-e397-4a56-8627-d374cf1333e3 for instance a719e8e5-c9aa-4e96-ba41-eae5881e5b06 on hv-cinder-85032 Sep 09 23:21:38.121022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c0d810ee-74a0-4451-ad83-3b25767d7259 req-01c1993f-9b44-4b1e-b497-16445d010bbf service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121058) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 23:21:38.121421 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c0d810ee-74a0-4451-ad83-3b25767d7259 req-01c1993f-9b44-4b1e-b497-16445d010bbf service nova] Acquired lock "compute-rpcapi-router" {{(pid=121058) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 23:21:38.123198 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-78ff0c46-12c5-48cf-85c1-a144d04792a3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:38.123934 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-78ff0c46-12c5-48cf-85c1-a144d04792a3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:38.124693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-78ff0c46-12c5-48cf-85c1-a144d04792a3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:38.126114 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-78ff0c46-12c5-48cf-85c1-a144d04792a3 None None] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:38.126857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-78ff0c46-12c5-48cf-85c1-a144d04792a3 None None] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:38.128893 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-78ff0c46-12c5-48cf-85c1-a144d04792a3 None None] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:38.149848 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.compute.rpcapi [None req-78ff0c46-12c5-48cf-85c1-a144d04792a3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 23:21:38.151121 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-78ff0c46-12c5-48cf-85c1-a144d04792a3 None None] Releasing lock "compute-rpcapi-router" {{(pid=121058) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 23:21:38.179310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-78ff0c46-12c5-48cf-85c1-a144d04792a3 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108712 Sep 09 23:21:38.181106 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 22/64] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:38.716960 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d2defe1d-aae6-40f7-b7c2-da3564c5d191 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:38.716960 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d2defe1d-aae6-40f7-b7c2-da3564c5d191 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:38.720605 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2defe1d-aae6-40f7-b7c2-da3564c5d191 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:38.721309 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2defe1d-aae6-40f7-b7c2-da3564c5d191 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:38.721898 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2defe1d-aae6-40f7-b7c2-da3564c5d191 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:38.722693 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2defe1d-aae6-40f7-b7c2-da3564c5d191 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:38.723342 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2defe1d-aae6-40f7-b7c2-da3564c5d191 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:38.723769 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2defe1d-aae6-40f7-b7c2-da3564c5d191 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:38.774953 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8ed54e67-51b7-4b76-9112-26cbf328f265 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:38.776647 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8ed54e67-51b7-4b76-9112-26cbf328f265 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:38.792682 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ed54e67-51b7-4b76-9112-26cbf328f265 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:38.793322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ed54e67-51b7-4b76-9112-26cbf328f265 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:38.793767 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ed54e67-51b7-4b76-9112-26cbf328f265 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:38.794525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ed54e67-51b7-4b76-9112-26cbf328f265 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:38.795010 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ed54e67-51b7-4b76-9112-26cbf328f265 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:38.795437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ed54e67-51b7-4b76-9112-26cbf328f265 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:39.057647 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d2defe1d-aae6-40f7-b7c2-da3564c5d191 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:39.065579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d2defe1d-aae6-40f7-b7c2-da3564c5d191 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1322 microversion: 2.1 time: 0.359214 Sep 09 23:21:39.066158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 43/65] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:38 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:39.080935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8f6a253d-8378-47f2-ac00-eb355abb7bce tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:39.083636 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8f6a253d-8378-47f2-ac00-eb355abb7bce tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:39.097338 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8ed54e67-51b7-4b76-9112-26cbf328f265 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:39.097500 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f6a253d-8378-47f2-ac00-eb355abb7bce tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:39.097892 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f6a253d-8378-47f2-ac00-eb355abb7bce tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:39.098325 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f6a253d-8378-47f2-ac00-eb355abb7bce tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:39.099046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f6a253d-8378-47f2-ac00-eb355abb7bce tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:39.099490 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f6a253d-8378-47f2-ac00-eb355abb7bce tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:39.102641 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f6a253d-8378-47f2-ac00-eb355abb7bce tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:39.108753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8ed54e67-51b7-4b76-9112-26cbf328f265 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1290 microversion: 2.1 time: 0.338284 Sep 09 23:21:39.130395 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 23/66] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:38 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1290 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:21:39.369055 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8f6a253d-8378-47f2-ac00-eb355abb7bce tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:39.379771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8f6a253d-8378-47f2-ac00-eb355abb7bce tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.304013 Sep 09 23:21:39.380969 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 44/67] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:39 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:40.089939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c1b7e40a-1d0f-44a1-960f-6c042c0892bb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:40.091250 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c1b7e40a-1d0f-44a1-960f-6c042c0892bb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:40.101952 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1b7e40a-1d0f-44a1-960f-6c042c0892bb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:40.102456 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1b7e40a-1d0f-44a1-960f-6c042c0892bb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:40.102956 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1b7e40a-1d0f-44a1-960f-6c042c0892bb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:40.103938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1b7e40a-1d0f-44a1-960f-6c042c0892bb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:40.104400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1b7e40a-1d0f-44a1-960f-6c042c0892bb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:40.104829 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1b7e40a-1d0f-44a1-960f-6c042c0892bb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:40.133577 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7702a43d-0174-413d-86ac-f05c9a9b1909 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:40.138022 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7702a43d-0174-413d-86ac-f05c9a9b1909 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:40.141446 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7702a43d-0174-413d-86ac-f05c9a9b1909 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:40.141757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7702a43d-0174-413d-86ac-f05c9a9b1909 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:40.142266 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7702a43d-0174-413d-86ac-f05c9a9b1909 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:40.143218 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7702a43d-0174-413d-86ac-f05c9a9b1909 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:40.143639 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7702a43d-0174-413d-86ac-f05c9a9b1909 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:40.144064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7702a43d-0174-413d-86ac-f05c9a9b1909 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:40.213080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7702a43d-0174-413d-86ac-f05c9a9b1909 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:40.222471 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7702a43d-0174-413d-86ac-f05c9a9b1909 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1290 microversion: 2.1 time: 0.092812 Sep 09 23:21:40.233201 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 45/68] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:40 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:21:40.268101 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c1b7e40a-1d0f-44a1-960f-6c042c0892bb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:40.276168 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c1b7e40a-1d0f-44a1-960f-6c042c0892bb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1322 microversion: 2.1 time: 0.190250 Sep 09 23:21:40.279135 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 24/69] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:40 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:40.443933 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-cfa0f109-a940-4166-8ff9-b11b67b66371 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:40.444635 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-cfa0f109-a940-4166-8ff9-b11b67b66371 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:40.454315 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cfa0f109-a940-4166-8ff9-b11b67b66371 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:40.454914 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cfa0f109-a940-4166-8ff9-b11b67b66371 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:40.456028 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cfa0f109-a940-4166-8ff9-b11b67b66371 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:40.456908 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cfa0f109-a940-4166-8ff9-b11b67b66371 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:40.457397 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cfa0f109-a940-4166-8ff9-b11b67b66371 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:40.457830 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cfa0f109-a940-4166-8ff9-b11b67b66371 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:40.462224 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=100 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:40.685731 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cfa0f109-a940-4166-8ff9-b11b67b66371 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:40.695964 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-cfa0f109-a940-4166-8ff9-b11b67b66371 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.257401 Sep 09 23:21:40.706459 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 46/70] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:40 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:41.252786 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4cf4f5bb-9c2b-45ab-8c0d-4e3d633bcb62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:41.252786 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4cf4f5bb-9c2b-45ab-8c0d-4e3d633bcb62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:41.258687 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4cf4f5bb-9c2b-45ab-8c0d-4e3d633bcb62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:41.259313 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4cf4f5bb-9c2b-45ab-8c0d-4e3d633bcb62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:41.259823 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4cf4f5bb-9c2b-45ab-8c0d-4e3d633bcb62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:41.260512 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4cf4f5bb-9c2b-45ab-8c0d-4e3d633bcb62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:41.260964 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4cf4f5bb-9c2b-45ab-8c0d-4e3d633bcb62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:41.261691 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4cf4f5bb-9c2b-45ab-8c0d-4e3d633bcb62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:41.301407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-306ff077-5803-4d17-839c-11d4f096f57e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:41.303037 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-306ff077-5803-4d17-839c-11d4f096f57e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:41.311493 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-306ff077-5803-4d17-839c-11d4f096f57e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:41.312135 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-306ff077-5803-4d17-839c-11d4f096f57e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:41.312668 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-306ff077-5803-4d17-839c-11d4f096f57e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:41.313557 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-306ff077-5803-4d17-839c-11d4f096f57e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:41.314074 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-306ff077-5803-4d17-839c-11d4f096f57e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:41.314592 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-306ff077-5803-4d17-839c-11d4f096f57e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:41.333310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4cf4f5bb-9c2b-45ab-8c0d-4e3d633bcb62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:41.341399 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4cf4f5bb-9c2b-45ab-8c0d-4e3d633bcb62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1298 microversion: 2.1 time: 0.096400 Sep 09 23:21:41.341974 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 25/71] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:41 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:41.458902 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-306ff077-5803-4d17-839c-11d4f096f57e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:41.467603 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-306ff077-5803-4d17-839c-11d4f096f57e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1322 microversion: 2.1 time: 0.171503 Sep 09 23:21:41.468348 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 47/72] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:41 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:21:41.722689 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3fee6427-6168-4278-ad24-1e2980b485a6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:41.723243 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3fee6427-6168-4278-ad24-1e2980b485a6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:41.729409 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3fee6427-6168-4278-ad24-1e2980b485a6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:41.741698 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3fee6427-6168-4278-ad24-1e2980b485a6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:41.741698 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3fee6427-6168-4278-ad24-1e2980b485a6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:41.741698 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3fee6427-6168-4278-ad24-1e2980b485a6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:41.741698 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3fee6427-6168-4278-ad24-1e2980b485a6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:41.742156 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3fee6427-6168-4278-ad24-1e2980b485a6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:41.872288 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3fee6427-6168-4278-ad24-1e2980b485a6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:41.883986 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3fee6427-6168-4278-ad24-1e2980b485a6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.163684 Sep 09 23:21:41.883986 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 26/73] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:41 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:42.367521 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-354d8f68-c1ac-4ba4-9b5c-fcfa45729756 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:42.368715 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-354d8f68-c1ac-4ba4-9b5c-fcfa45729756 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:42.375089 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-354d8f68-c1ac-4ba4-9b5c-fcfa45729756 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:42.376553 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-354d8f68-c1ac-4ba4-9b5c-fcfa45729756 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:42.377090 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-354d8f68-c1ac-4ba4-9b5c-fcfa45729756 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:42.378040 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-354d8f68-c1ac-4ba4-9b5c-fcfa45729756 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:42.378703 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-354d8f68-c1ac-4ba4-9b5c-fcfa45729756 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:42.379183 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-354d8f68-c1ac-4ba4-9b5c-fcfa45729756 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:42.489024 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-354d8f68-c1ac-4ba4-9b5c-fcfa45729756 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:42.497493 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-354d8f68-c1ac-4ba4-9b5c-fcfa45729756 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1298 microversion: 2.1 time: 0.134428 Sep 09 23:21:42.510537 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 48/74] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:42 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1298 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:42.510797 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-038fb2ad-f96a-4559-92dc-35dc8b01515d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:42.510797 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-038fb2ad-f96a-4559-92dc-35dc8b01515d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:42.510797 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:42.510797 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-038fb2ad-f96a-4559-92dc-35dc8b01515d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:42.511424 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-038fb2ad-f96a-4559-92dc-35dc8b01515d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:42.511424 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-038fb2ad-f96a-4559-92dc-35dc8b01515d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:42.511424 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-038fb2ad-f96a-4559-92dc-35dc8b01515d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:42.511424 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-038fb2ad-f96a-4559-92dc-35dc8b01515d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:42.511748 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-038fb2ad-f96a-4559-92dc-35dc8b01515d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:42.514731 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=77 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:42.748677 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-038fb2ad-f96a-4559-92dc-35dc8b01515d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:42.759976 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-038fb2ad-f96a-4559-92dc-35dc8b01515d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1322 microversion: 2.1 time: 0.265620 Sep 09 23:21:42.774619 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 27/75] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:42 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:21:42.910146 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e6623251-a54d-4e5f-852c-76b2a832fc4b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:42.910146 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e6623251-a54d-4e5f-852c-76b2a832fc4b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:42.935490 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e6623251-a54d-4e5f-852c-76b2a832fc4b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:42.941010 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e6623251-a54d-4e5f-852c-76b2a832fc4b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:42.941624 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e6623251-a54d-4e5f-852c-76b2a832fc4b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:42.943628 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e6623251-a54d-4e5f-852c-76b2a832fc4b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:42.944737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e6623251-a54d-4e5f-852c-76b2a832fc4b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:42.945529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e6623251-a54d-4e5f-852c-76b2a832fc4b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:43.291545 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e6623251-a54d-4e5f-852c-76b2a832fc4b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:43.306099 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e6623251-a54d-4e5f-852c-76b2a832fc4b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.403585 Sep 09 23:21:43.324876 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 49/76] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:42 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:43.524431 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5478db30-633f-4d6c-a9f7-ba584f4f5c6a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:43.525221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5478db30-633f-4d6c-a9f7-ba584f4f5c6a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:43.535727 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5478db30-633f-4d6c-a9f7-ba584f4f5c6a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:43.536432 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5478db30-633f-4d6c-a9f7-ba584f4f5c6a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:43.537025 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5478db30-633f-4d6c-a9f7-ba584f4f5c6a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:43.537885 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5478db30-633f-4d6c-a9f7-ba584f4f5c6a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:43.538708 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5478db30-633f-4d6c-a9f7-ba584f4f5c6a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:43.539969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5478db30-633f-4d6c-a9f7-ba584f4f5c6a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:43.618252 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5478db30-633f-4d6c-a9f7-ba584f4f5c6a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:43.633665 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5478db30-633f-4d6c-a9f7-ba584f4f5c6a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1296 microversion: 2.1 time: 0.114047 Sep 09 23:21:43.647523 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 28/77] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:43 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1296 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:43.784107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e6f22889-64c1-4e19-be36-d5cd9db42584 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:43.784728 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e6f22889-64c1-4e19-be36-d5cd9db42584 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:43.786629 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=16 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:43.791388 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e6f22889-64c1-4e19-be36-d5cd9db42584 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:43.791879 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e6f22889-64c1-4e19-be36-d5cd9db42584 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:43.796521 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e6f22889-64c1-4e19-be36-d5cd9db42584 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:43.796521 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e6f22889-64c1-4e19-be36-d5cd9db42584 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:43.796521 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e6f22889-64c1-4e19-be36-d5cd9db42584 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:43.796521 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e6f22889-64c1-4e19-be36-d5cd9db42584 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:44.019658 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e6f22889-64c1-4e19-be36-d5cd9db42584 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:44.027601 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e6f22889-64c1-4e19-be36-d5cd9db42584 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1322 microversion: 2.1 time: 0.247581 Sep 09 23:21:44.028389 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 50/78] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:43 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:44.330238 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8be3c9f0-d959-4794-811e-9ac438fdfc93 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:44.331378 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8be3c9f0-d959-4794-811e-9ac438fdfc93 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:44.343265 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8be3c9f0-d959-4794-811e-9ac438fdfc93 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:44.343806 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8be3c9f0-d959-4794-811e-9ac438fdfc93 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:44.345208 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8be3c9f0-d959-4794-811e-9ac438fdfc93 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:44.347728 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8be3c9f0-d959-4794-811e-9ac438fdfc93 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:44.348208 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8be3c9f0-d959-4794-811e-9ac438fdfc93 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:44.348638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8be3c9f0-d959-4794-811e-9ac438fdfc93 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:44.661104 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-2e470274-c543-4134-af35-dfac6b8d06c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:44.663731 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-2e470274-c543-4134-af35-dfac6b8d06c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:44.692144 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2e470274-c543-4134-af35-dfac6b8d06c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:44.692916 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2e470274-c543-4134-af35-dfac6b8d06c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:44.694223 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2e470274-c543-4134-af35-dfac6b8d06c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:44.696581 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2e470274-c543-4134-af35-dfac6b8d06c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:44.698394 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2e470274-c543-4134-af35-dfac6b8d06c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:44.699011 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2e470274-c543-4134-af35-dfac6b8d06c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:44.896748 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8be3c9f0-d959-4794-811e-9ac438fdfc93 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:44.905875 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8be3c9f0-d959-4794-811e-9ac438fdfc93 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.580700 Sep 09 23:21:44.916750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 29/79] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:44 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:45.055755 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7ed74304-a435-49e8-ae6a-ed6b649e2e68 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:45.056628 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7ed74304-a435-49e8-ae6a-ed6b649e2e68 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:45.065950 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=26 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:45.079808 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7ed74304-a435-49e8-ae6a-ed6b649e2e68 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:45.080852 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7ed74304-a435-49e8-ae6a-ed6b649e2e68 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:45.081541 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7ed74304-a435-49e8-ae6a-ed6b649e2e68 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:45.082643 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7ed74304-a435-49e8-ae6a-ed6b649e2e68 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:45.084144 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7ed74304-a435-49e8-ae6a-ed6b649e2e68 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:45.086289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7ed74304-a435-49e8-ae6a-ed6b649e2e68 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:45.149743 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-2e470274-c543-4134-af35-dfac6b8d06c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:45.163783 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-2e470274-c543-4134-af35-dfac6b8d06c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1363 microversion: 2.1 time: 0.508057 Sep 09 23:21:45.168557 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 51/80] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:44 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1363 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:45.483567 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7ed74304-a435-49e8-ae6a-ed6b649e2e68 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:45.496423 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7ed74304-a435-49e8-ae6a-ed6b649e2e68 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1322 microversion: 2.1 time: 0.449024 Sep 09 23:21:45.497534 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 30/81] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:45 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:45.943394 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a1b448c1-b53a-4c02-ba40-f4f52191c310 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:45.944361 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a1b448c1-b53a-4c02-ba40-f4f52191c310 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:45.947692 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=4 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:45.951349 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a1b448c1-b53a-4c02-ba40-f4f52191c310 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:45.951840 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a1b448c1-b53a-4c02-ba40-f4f52191c310 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:45.952278 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a1b448c1-b53a-4c02-ba40-f4f52191c310 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:45.952980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a1b448c1-b53a-4c02-ba40-f4f52191c310 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:45.954007 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a1b448c1-b53a-4c02-ba40-f4f52191c310 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:45.954731 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a1b448c1-b53a-4c02-ba40-f4f52191c310 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:46.081347 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-a03f7785-cfad-49c6-a3c6-03616fdbb29d req-e7296bc2-a14b-449a-85a7-3099d14356d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e56bd49b-8d5d-4de6-a394-2d097824a7c4", "tag": "b86274a6-1ece-499f-902e-c213794d1b58"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:46.102569 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-a03f7785-cfad-49c6-a3c6-03616fdbb29d req-e7296bc2-a14b-449a-85a7-3099d14356d4 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:46.103186 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-a03f7785-cfad-49c6-a3c6-03616fdbb29d req-e7296bc2-a14b-449a-85a7-3099d14356d4 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:46.103924 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-a03f7785-cfad-49c6-a3c6-03616fdbb29d req-e7296bc2-a14b-449a-85a7-3099d14356d4 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:46.126206 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-a03f7785-cfad-49c6-a3c6-03616fdbb29d req-e7296bc2-a14b-449a-85a7-3099d14356d4 service nova] Creating event network-changed:b86274a6-1ece-499f-902e-c213794d1b58 for instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 on hv-cinder-85032 Sep 09 23:21:46.144826 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-a03f7785-cfad-49c6-a3c6-03616fdbb29d req-e7296bc2-a14b-449a-85a7-3099d14356d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069859 Sep 09 23:21:46.145992 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 31/82] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:21:46.197328 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0ec69147-a909-4d82-a81b-b1d4535153e4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:46.198188 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0ec69147-a909-4d82-a81b-b1d4535153e4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:46.207065 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0ec69147-a909-4d82-a81b-b1d4535153e4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:46.210941 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0ec69147-a909-4d82-a81b-b1d4535153e4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:46.211454 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0ec69147-a909-4d82-a81b-b1d4535153e4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:46.213636 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0ec69147-a909-4d82-a81b-b1d4535153e4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:46.214694 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0ec69147-a909-4d82-a81b-b1d4535153e4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:46.216976 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0ec69147-a909-4d82-a81b-b1d4535153e4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:46.251088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a1b448c1-b53a-4c02-ba40-f4f52191c310 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:46.264632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a1b448c1-b53a-4c02-ba40-f4f52191c310 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.325099 Sep 09 23:21:46.265813 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 52/83] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:45 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:46.527618 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0856334f-0288-41a7-9209-fb6c4d249fa6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:46.528227 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-0856334f-0288-41a7-9209-fb6c4d249fa6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:46.550181 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0856334f-0288-41a7-9209-fb6c4d249fa6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:46.552289 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0856334f-0288-41a7-9209-fb6c4d249fa6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:46.552895 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0856334f-0288-41a7-9209-fb6c4d249fa6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:46.554023 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0856334f-0288-41a7-9209-fb6c4d249fa6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:46.556011 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0856334f-0288-41a7-9209-fb6c4d249fa6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:46.559551 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0856334f-0288-41a7-9209-fb6c4d249fa6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:46.790295 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0ec69147-a909-4d82-a81b-b1d4535153e4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:46.809105 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0ec69147-a909-4d82-a81b-b1d4535153e4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1363 microversion: 2.1 time: 0.617285 Sep 09 23:21:46.810876 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 32/84] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:46 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1363 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:21:47.108431 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-0856334f-0288-41a7-9209-fb6c4d249fa6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:47.122740 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-0856334f-0288-41a7-9209-fb6c4d249fa6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1322 microversion: 2.1 time: 0.598942 Sep 09 23:21:47.124822 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 53/85] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:46 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1322 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:47.296092 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-19ed9cc9-4975-44cf-bda1-005d191dc717 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:47.296708 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-19ed9cc9-4975-44cf-bda1-005d191dc717 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:47.315028 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-19ed9cc9-4975-44cf-bda1-005d191dc717 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:47.315428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-19ed9cc9-4975-44cf-bda1-005d191dc717 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:47.316068 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-19ed9cc9-4975-44cf-bda1-005d191dc717 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:47.316782 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-19ed9cc9-4975-44cf-bda1-005d191dc717 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:47.317232 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-19ed9cc9-4975-44cf-bda1-005d191dc717 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:47.318644 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-19ed9cc9-4975-44cf-bda1-005d191dc717 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:47.552397 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-19ed9cc9-4975-44cf-bda1-005d191dc717 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:47.560573 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-19ed9cc9-4975-44cf-bda1-005d191dc717 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.269861 Sep 09 23:21:47.562154 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 33/86] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:47 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:47.833770 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f25e8618-ff8b-4715-bc2e-9d7d58eb7a2c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:47.834199 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f25e8618-ff8b-4715-bc2e-9d7d58eb7a2c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:47.839766 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:47.841561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f25e8618-ff8b-4715-bc2e-9d7d58eb7a2c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:47.842099 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f25e8618-ff8b-4715-bc2e-9d7d58eb7a2c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:47.842773 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f25e8618-ff8b-4715-bc2e-9d7d58eb7a2c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:47.843677 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f25e8618-ff8b-4715-bc2e-9d7d58eb7a2c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:47.851383 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f25e8618-ff8b-4715-bc2e-9d7d58eb7a2c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:47.852071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f25e8618-ff8b-4715-bc2e-9d7d58eb7a2c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:48.052030 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f25e8618-ff8b-4715-bc2e-9d7d58eb7a2c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:48.060146 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f25e8618-ff8b-4715-bc2e-9d7d58eb7a2c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1363 microversion: 2.1 time: 0.230320 Sep 09 23:21:48.060744 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 54/87] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:47 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:48.149657 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3ce3e98f-df77-4c6b-b217-ec5fd99876cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:48.150276 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3ce3e98f-df77-4c6b-b217-ec5fd99876cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:48.153308 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=4 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:48.159263 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ce3e98f-df77-4c6b-b217-ec5fd99876cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:48.159753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ce3e98f-df77-4c6b-b217-ec5fd99876cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:48.160214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ce3e98f-df77-4c6b-b217-ec5fd99876cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:48.160911 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ce3e98f-df77-4c6b-b217-ec5fd99876cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:48.161367 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ce3e98f-df77-4c6b-b217-ec5fd99876cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:48.161785 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ce3e98f-df77-4c6b-b217-ec5fd99876cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:48.362848 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3ce3e98f-df77-4c6b-b217-ec5fd99876cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:48.373139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3ce3e98f-df77-4c6b-b217-ec5fd99876cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1322 microversion: 2.1 time: 0.227475 Sep 09 23:21:48.374659 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 34/88] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:48 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:48.600774 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-42112c4b-e78d-47ec-aa07-291c42bf64d6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:48.600774 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-42112c4b-e78d-47ec-aa07-291c42bf64d6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:48.619414 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-42112c4b-e78d-47ec-aa07-291c42bf64d6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:48.622962 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-42112c4b-e78d-47ec-aa07-291c42bf64d6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:48.627544 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-42112c4b-e78d-47ec-aa07-291c42bf64d6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:48.629644 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-42112c4b-e78d-47ec-aa07-291c42bf64d6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:48.632213 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-42112c4b-e78d-47ec-aa07-291c42bf64d6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:48.635449 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-42112c4b-e78d-47ec-aa07-291c42bf64d6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:49.043759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-42112c4b-e78d-47ec-aa07-291c42bf64d6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:49.052943 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-42112c4b-e78d-47ec-aa07-291c42bf64d6 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.472033 Sep 09 23:21:49.054297 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 55/89] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:48 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:49.091098 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ef375a87-e63d-486f-b385-52ee1957bfd3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:49.092975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ef375a87-e63d-486f-b385-52ee1957bfd3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:49.106620 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ef375a87-e63d-486f-b385-52ee1957bfd3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:49.107112 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ef375a87-e63d-486f-b385-52ee1957bfd3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:49.110020 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ef375a87-e63d-486f-b385-52ee1957bfd3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:49.111361 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ef375a87-e63d-486f-b385-52ee1957bfd3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:49.112277 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ef375a87-e63d-486f-b385-52ee1957bfd3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:49.113306 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ef375a87-e63d-486f-b385-52ee1957bfd3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:49.318576 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ef375a87-e63d-486f-b385-52ee1957bfd3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:49.326334 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ef375a87-e63d-486f-b385-52ee1957bfd3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1363 microversion: 2.1 time: 0.245569 Sep 09 23:21:49.342127 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 35/90] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:49 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:49.400550 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0cf7600d-809f-4fbe-a7a0-dba892978ef7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:49.404844 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0cf7600d-809f-4fbe-a7a0-dba892978ef7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:49.411980 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0cf7600d-809f-4fbe-a7a0-dba892978ef7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:49.412641 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0cf7600d-809f-4fbe-a7a0-dba892978ef7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:49.413237 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0cf7600d-809f-4fbe-a7a0-dba892978ef7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:49.414102 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0cf7600d-809f-4fbe-a7a0-dba892978ef7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:49.414588 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0cf7600d-809f-4fbe-a7a0-dba892978ef7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:49.415018 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0cf7600d-809f-4fbe-a7a0-dba892978ef7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:49.497784 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-da1826c9-4a89-4afa-810b-e4ad5291d000 req-0447dedc-1c46-4718-a678-1797cc36156c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98941a2f-f38e-401c-952d-0306b886414b", "name": "network-vif-plugged", "status": "completed", "tag": "68303a0a-a147-4bf7-bc4c-c100d86bdfbb"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:49.513217 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-da1826c9-4a89-4afa-810b-e4ad5291d000 req-0447dedc-1c46-4718-a678-1797cc36156c service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:49.513694 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-da1826c9-4a89-4afa-810b-e4ad5291d000 req-0447dedc-1c46-4718-a678-1797cc36156c service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:49.514122 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-da1826c9-4a89-4afa-810b-e4ad5291d000 req-0447dedc-1c46-4718-a678-1797cc36156c service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:49.525827 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-da1826c9-4a89-4afa-810b-e4ad5291d000 req-0447dedc-1c46-4718-a678-1797cc36156c service nova] Creating event network-vif-plugged:68303a0a-a147-4bf7-bc4c-c100d86bdfbb for instance 98941a2f-f38e-401c-952d-0306b886414b on hv-cinder-85032 Sep 09 23:21:49.531311 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-da1826c9-4a89-4afa-810b-e4ad5291d000 req-0447dedc-1c46-4718-a678-1797cc36156c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138879 Sep 09 23:21:49.535362 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 56/91] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:49.619304 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0cf7600d-809f-4fbe-a7a0-dba892978ef7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:49.629915 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0cf7600d-809f-4fbe-a7a0-dba892978ef7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1322 microversion: 2.1 time: 0.233289 Sep 09 23:21:49.630816 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 36/92] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:49 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:50.084639 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-246f230e-ba5f-4119-867b-775fa6c17927 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:50.085387 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-246f230e-ba5f-4119-867b-775fa6c17927 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:50.091472 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-246f230e-ba5f-4119-867b-775fa6c17927 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:50.091948 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-246f230e-ba5f-4119-867b-775fa6c17927 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:50.092377 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-246f230e-ba5f-4119-867b-775fa6c17927 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:50.093062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-246f230e-ba5f-4119-867b-775fa6c17927 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:50.093508 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-246f230e-ba5f-4119-867b-775fa6c17927 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:50.094585 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-246f230e-ba5f-4119-867b-775fa6c17927 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:50.320262 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-246f230e-ba5f-4119-867b-775fa6c17927 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:50.329974 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-246f230e-ba5f-4119-867b-775fa6c17927 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.249537 Sep 09 23:21:50.336303 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 57/93] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:50 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:50.353454 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8d49b345-0d25-4fb9-ba22-ee065bab11a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:50.355117 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8d49b345-0d25-4fb9-ba22-ee065bab11a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:50.362477 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d49b345-0d25-4fb9-ba22-ee065bab11a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:50.363403 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d49b345-0d25-4fb9-ba22-ee065bab11a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:50.363998 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d49b345-0d25-4fb9-ba22-ee065bab11a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:50.364898 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d49b345-0d25-4fb9-ba22-ee065bab11a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:50.365359 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d49b345-0d25-4fb9-ba22-ee065bab11a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:50.365778 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d49b345-0d25-4fb9-ba22-ee065bab11a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:50.530031 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8d49b345-0d25-4fb9-ba22-ee065bab11a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:50.550620 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8d49b345-0d25-4fb9-ba22-ee065bab11a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1363 microversion: 2.1 time: 0.201712 Sep 09 23:21:50.563582 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 37/94] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:50 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:50.654482 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-53738c85-9dee-43a0-b033-fe58956fb899 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:50.655370 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-53738c85-9dee-43a0-b033-fe58956fb899 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:50.665920 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53738c85-9dee-43a0-b033-fe58956fb899 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:50.671232 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53738c85-9dee-43a0-b033-fe58956fb899 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:50.671232 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53738c85-9dee-43a0-b033-fe58956fb899 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:50.671232 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53738c85-9dee-43a0-b033-fe58956fb899 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:50.671232 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53738c85-9dee-43a0-b033-fe58956fb899 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:50.671644 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53738c85-9dee-43a0-b033-fe58956fb899 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:50.854911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-53738c85-9dee-43a0-b033-fe58956fb899 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:50.863667 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-53738c85-9dee-43a0-b033-fe58956fb899 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1322 microversion: 2.1 time: 0.214386 Sep 09 23:21:50.866488 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 58/95] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:50 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:51.361420 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8ebb4633-d959-418c-9095-e73957c86e90 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:51.362358 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8ebb4633-d959-418c-9095-e73957c86e90 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:51.382759 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ebb4633-d959-418c-9095-e73957c86e90 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:51.383271 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ebb4633-d959-418c-9095-e73957c86e90 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:51.383720 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ebb4633-d959-418c-9095-e73957c86e90 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:51.384446 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ebb4633-d959-418c-9095-e73957c86e90 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:51.387056 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ebb4633-d959-418c-9095-e73957c86e90 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:51.387534 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ebb4633-d959-418c-9095-e73957c86e90 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:51.547625 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-dfe9e0f3-0779-446d-828c-542eb7c19185 req-adc864ac-5f0e-4529-961a-4561f98f61b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b8a715-050b-4cbd-aff9-747f65d1e8b5", "name": "network-vif-plugged", "status": "completed", "tag": "9a2bd38a-1f80-486d-8e11-48bf4e66c96d"}, {"server_uuid": "a719e8e5-c9aa-4e96-ba41-eae5881e5b06", "name": "network-vif-plugged", "status": "completed", "tag": "2128df64-e397-4a56-8627-d374cf1333e3"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:51.560257 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-dfe9e0f3-0779-446d-828c-542eb7c19185 req-adc864ac-5f0e-4529-961a-4561f98f61b1 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:51.561179 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-dfe9e0f3-0779-446d-828c-542eb7c19185 req-adc864ac-5f0e-4529-961a-4561f98f61b1 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:51.562135 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-dfe9e0f3-0779-446d-828c-542eb7c19185 req-adc864ac-5f0e-4529-961a-4561f98f61b1 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:51.572159 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8ebb4633-d959-418c-9095-e73957c86e90 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:51.582189 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-dfe9e0f3-0779-446d-828c-542eb7c19185 req-adc864ac-5f0e-4529-961a-4561f98f61b1 service nova] Creating event network-vif-plugged:9a2bd38a-1f80-486d-8e11-48bf4e66c96d for instance e2b8a715-050b-4cbd-aff9-747f65d1e8b5 on hv-cinder-85032 Sep 09 23:21:51.582822 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-dfe9e0f3-0779-446d-828c-542eb7c19185 req-adc864ac-5f0e-4529-961a-4561f98f61b1 service nova] Creating event network-vif-plugged:2128df64-e397-4a56-8627-d374cf1333e3 for instance a719e8e5-c9aa-4e96-ba41-eae5881e5b06 on hv-cinder-85032 Sep 09 23:21:51.582946 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8ebb4633-d959-418c-9095-e73957c86e90 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.229138 Sep 09 23:21:51.583808 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 38/96] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:51 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:51.588595 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-333c6535-f40c-4d08-8cb3-613e24551c62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:51.589365 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-333c6535-f40c-4d08-8cb3-613e24551c62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:51.590421 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-dfe9e0f3-0779-446d-828c-542eb7c19185 req-adc864ac-5f0e-4529-961a-4561f98f61b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046978 Sep 09 23:21:51.595773 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 59/97] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:51.598149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-333c6535-f40c-4d08-8cb3-613e24551c62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:51.598691 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-333c6535-f40c-4d08-8cb3-613e24551c62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:51.599368 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-333c6535-f40c-4d08-8cb3-613e24551c62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:51.600476 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-333c6535-f40c-4d08-8cb3-613e24551c62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:51.601146 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-333c6535-f40c-4d08-8cb3-613e24551c62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:51.601757 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-333c6535-f40c-4d08-8cb3-613e24551c62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:51.868860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-333c6535-f40c-4d08-8cb3-613e24551c62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:51.878565 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-333c6535-f40c-4d08-8cb3-613e24551c62 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1363 microversion: 2.1 time: 0.293544 Sep 09 23:21:51.879696 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 39/98] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:51 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:51.887019 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4bff52c3-98de-402e-9977-7a0af7a4d2af tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:51.887747 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4bff52c3-98de-402e-9977-7a0af7a4d2af tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:51.896157 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4bff52c3-98de-402e-9977-7a0af7a4d2af tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:51.896639 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4bff52c3-98de-402e-9977-7a0af7a4d2af tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:51.897068 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4bff52c3-98de-402e-9977-7a0af7a4d2af tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:51.897749 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4bff52c3-98de-402e-9977-7a0af7a4d2af tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:51.898264 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4bff52c3-98de-402e-9977-7a0af7a4d2af tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:51.898704 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4bff52c3-98de-402e-9977-7a0af7a4d2af tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:52.187419 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4bff52c3-98de-402e-9977-7a0af7a4d2af tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:52.196492 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4bff52c3-98de-402e-9977-7a0af7a4d2af tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1322 microversion: 2.1 time: 0.313580 Sep 09 23:21:52.206550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 60/99] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:51 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:52.260311 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1083059948", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "networks": [{"uuid": "b60acfc9-5746-4d6b-bb71-8a6ecb35589e"}]}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:52.321987 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.network.neutron [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] validate_networks() for [('b60acfc9-5746-4d6b-bb71-8a6ecb35589e', None, None, None, None, None)] {{(pid=121058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:21:52.619266 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-52fa1a6e-308b-42ca-82e6-34bad1b613cd tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:52.619803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-52fa1a6e-308b-42ca-82e6-34bad1b613cd tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:52.626205 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-52fa1a6e-308b-42ca-82e6-34bad1b613cd tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:52.626838 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-52fa1a6e-308b-42ca-82e6-34bad1b613cd tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:52.627275 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-52fa1a6e-308b-42ca-82e6-34bad1b613cd tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:52.628237 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-52fa1a6e-308b-42ca-82e6-34bad1b613cd tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:52.628755 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-52fa1a6e-308b-42ca-82e6-34bad1b613cd tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:52.629188 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-52fa1a6e-308b-42ca-82e6-34bad1b613cd tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:52.801196 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-52fa1a6e-308b-42ca-82e6-34bad1b613cd tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:52.810664 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-52fa1a6e-308b-42ca-82e6-34bad1b613cd tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1315 microversion: 2.1 time: 0.203195 Sep 09 23:21:52.829891 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 61/100] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:52 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:52.903194 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8e3dc7a2-86e7-462c-803c-906f811394af tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:52.903844 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8e3dc7a2-86e7-462c-803c-906f811394af tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:52.910021 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e3dc7a2-86e7-462c-803c-906f811394af tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:52.910595 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e3dc7a2-86e7-462c-803c-906f811394af tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:52.911213 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e3dc7a2-86e7-462c-803c-906f811394af tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:52.912220 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e3dc7a2-86e7-462c-803c-906f811394af tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:52.912763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e3dc7a2-86e7-462c-803c-906f811394af tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:52.913388 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e3dc7a2-86e7-462c-803c-906f811394af tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:52.922732 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Flavor limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:21:52.923672 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Image limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:21:52.924151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Flavor pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:21:52.924565 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Image pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:21:52.924981 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:21:52.933866 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:52.934373 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:52.934838 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:52.935583 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:52.936049 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:52.936487 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:52.954086 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Getting quotas for project c31116d92493460793d41ba2a6a166e0. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:21:52.961896 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Getting quotas for user 72467431e40c491cad192b06be494175 and project c31116d92493460793d41ba2a6a166e0. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:21:52.974597 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Going to run 1 instances... {{(pid=121058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:21:52.995884 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:21:53.104429 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8e3dc7a2-86e7-462c-803c-906f811394af tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:53.114075 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8e3dc7a2-86e7-462c-803c-906f811394af tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1363 microversion: 2.1 time: 0.215315 Sep 09 23:21:53.124162 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 62/101] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:52 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:21:53.177884 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-2100dc1b-9b7c-4ef4-9caf-4cd59b589135 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921435 Sep 09 23:21:53.184730 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 40/102] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:21:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:21:53.197697 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8ac64b9b-e9a0-42b2-bd94-58914f5eae1f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:53.197697 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8ac64b9b-e9a0-42b2-bd94-58914f5eae1f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:53.220736 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-bddc3b78-fdc7-4322-8b04-905ac9b6ff96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:53.221449 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-bddc3b78-fdc7-4322-8b04-905ac9b6ff96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:53.234716 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bddc3b78-fdc7-4322-8b04-905ac9b6ff96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:53.234716 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bddc3b78-fdc7-4322-8b04-905ac9b6ff96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:53.235197 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bddc3b78-fdc7-4322-8b04-905ac9b6ff96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:53.236334 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bddc3b78-fdc7-4322-8b04-905ac9b6ff96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:53.236953 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bddc3b78-fdc7-4322-8b04-905ac9b6ff96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:53.237385 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bddc3b78-fdc7-4322-8b04-905ac9b6ff96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:53.274083 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8ac64b9b-e9a0-42b2-bd94-58914f5eae1f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:53.285040 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8ac64b9b-e9a0-42b2-bd94-58914f5eae1f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1219 microversion: 2.1 time: 0.096004 Sep 09 23:21:53.286038 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 63/103] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:53 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:53.436415 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bddc3b78-fdc7-4322-8b04-905ac9b6ff96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:53.444418 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-bddc3b78-fdc7-4322-8b04-905ac9b6ff96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1322 microversion: 2.1 time: 0.228917 Sep 09 23:21:53.445240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 41/104] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:53 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:21:53.616298 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-299204fd-2034-4c8d-9909-596468373b8a req-5b3e47fe-b950-48f8-b44f-e972d8915570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56bd49b-8d5d-4de6-a394-2d097824a7c4", "name": "network-vif-plugged", "status": "completed", "tag": "b86274a6-1ece-499f-902e-c213794d1b58"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:53.635255 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-299204fd-2034-4c8d-9909-596468373b8a req-5b3e47fe-b950-48f8-b44f-e972d8915570 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:53.635255 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-299204fd-2034-4c8d-9909-596468373b8a req-5b3e47fe-b950-48f8-b44f-e972d8915570 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:53.635255 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-299204fd-2034-4c8d-9909-596468373b8a req-5b3e47fe-b950-48f8-b44f-e972d8915570 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:53.639617 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-299204fd-2034-4c8d-9909-596468373b8a req-5b3e47fe-b950-48f8-b44f-e972d8915570 service nova] Creating event network-vif-plugged:b86274a6-1ece-499f-902e-c213794d1b58 for instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 on hv-cinder-85032 Sep 09 23:21:53.644910 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-299204fd-2034-4c8d-9909-596468373b8a req-5b3e47fe-b950-48f8-b44f-e972d8915570 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032734 Sep 09 23:21:53.645445 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 64/105] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:53.837020 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9edc6a93-03ac-4f13-a768-6809d2bfc236 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:53.837646 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9edc6a93-03ac-4f13-a768-6809d2bfc236 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:53.850576 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9edc6a93-03ac-4f13-a768-6809d2bfc236 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:53.850576 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9edc6a93-03ac-4f13-a768-6809d2bfc236 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:53.850576 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9edc6a93-03ac-4f13-a768-6809d2bfc236 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:53.851078 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9edc6a93-03ac-4f13-a768-6809d2bfc236 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:53.851549 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9edc6a93-03ac-4f13-a768-6809d2bfc236 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:53.851980 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9edc6a93-03ac-4f13-a768-6809d2bfc236 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:54.001384 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9edc6a93-03ac-4f13-a768-6809d2bfc236 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:54.009335 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9edc6a93-03ac-4f13-a768-6809d2bfc236 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1503 microversion: 2.1 time: 0.176043 Sep 09 23:21:54.014497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 42/106] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:53 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:54.147968 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-935683a1-b39e-4853-b58b-0f5d027c9eac tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:54.149138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-935683a1-b39e-4853-b58b-0f5d027c9eac tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:54.156688 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-935683a1-b39e-4853-b58b-0f5d027c9eac tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:54.157187 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-935683a1-b39e-4853-b58b-0f5d027c9eac tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:54.159559 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-935683a1-b39e-4853-b58b-0f5d027c9eac tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:54.160807 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-935683a1-b39e-4853-b58b-0f5d027c9eac tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:54.161278 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-935683a1-b39e-4853-b58b-0f5d027c9eac tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:54.162099 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-935683a1-b39e-4853-b58b-0f5d027c9eac tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:54.323526 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0ab37099-9590-464a-90cf-dd562ed84655 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:54.326548 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0ab37099-9590-464a-90cf-dd562ed84655 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:54.382718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-935683a1-b39e-4853-b58b-0f5d027c9eac tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:54.398742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=100 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:54.409029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-935683a1-b39e-4853-b58b-0f5d027c9eac tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1363 microversion: 2.1 time: 0.275711 Sep 09 23:21:54.426852 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 65/107] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:54 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:54.441360 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0ab37099-9590-464a-90cf-dd562ed84655 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:54.474181 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0ab37099-9590-464a-90cf-dd562ed84655 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1219 microversion: 2.1 time: 0.140366 Sep 09 23:21:54.474181 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 43/108] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:54 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1219 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:54.482315 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-385e4623-c693-4b4c-82b2-31731f799750 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:54.486534 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-385e4623-c693-4b4c-82b2-31731f799750 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:54.494752 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-385e4623-c693-4b4c-82b2-31731f799750 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:54.495533 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-385e4623-c693-4b4c-82b2-31731f799750 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:54.496306 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-385e4623-c693-4b4c-82b2-31731f799750 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:54.497073 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-385e4623-c693-4b4c-82b2-31731f799750 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:54.497709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-385e4623-c693-4b4c-82b2-31731f799750 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:54.498136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-385e4623-c693-4b4c-82b2-31731f799750 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:54.691637 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-385e4623-c693-4b4c-82b2-31731f799750 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:54.699416 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-385e4623-c693-4b4c-82b2-31731f799750 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1322 microversion: 2.1 time: 0.235460 Sep 09 23:21:54.699992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 66/109] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:54 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:55.486909 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-df3667ff-68b8-4836-bb3e-7ee03ce7aee2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:55.487597 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-df3667ff-68b8-4836-bb3e-7ee03ce7aee2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:55.493996 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ce1fd812-2858-4399-9daf-b4d135a0b70a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:55.494459 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-df3667ff-68b8-4836-bb3e-7ee03ce7aee2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:55.494698 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ce1fd812-2858-4399-9daf-b4d135a0b70a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:55.495022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-df3667ff-68b8-4836-bb3e-7ee03ce7aee2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:55.495463 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-df3667ff-68b8-4836-bb3e-7ee03ce7aee2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:55.496392 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-df3667ff-68b8-4836-bb3e-7ee03ce7aee2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:55.496873 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-df3667ff-68b8-4836-bb3e-7ee03ce7aee2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:55.497799 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-df3667ff-68b8-4836-bb3e-7ee03ce7aee2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:55.501339 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ce1fd812-2858-4399-9daf-b4d135a0b70a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:55.501863 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ce1fd812-2858-4399-9daf-b4d135a0b70a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:55.502652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ce1fd812-2858-4399-9daf-b4d135a0b70a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:55.512318 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ce1fd812-2858-4399-9daf-b4d135a0b70a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:55.512318 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ce1fd812-2858-4399-9daf-b4d135a0b70a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:55.512318 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ce1fd812-2858-4399-9daf-b4d135a0b70a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:55.569512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ce1fd812-2858-4399-9daf-b4d135a0b70a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:55.577627 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ce1fd812-2858-4399-9daf-b4d135a0b70a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1223 microversion: 2.1 time: 0.088457 Sep 09 23:21:55.578353 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 67/110] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:55 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:21:55.643125 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-df3667ff-68b8-4836-bb3e-7ee03ce7aee2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:55.652071 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-df3667ff-68b8-4836-bb3e-7ee03ce7aee2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1363 microversion: 2.1 time: 0.169064 Sep 09 23:21:55.653287 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 44/111] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:55 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:55.727112 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-93ae8758-fc76-421e-b0f8-d2cc0dcbf1a0 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:55.727739 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-93ae8758-fc76-421e-b0f8-d2cc0dcbf1a0 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:55.734379 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-93ae8758-fc76-421e-b0f8-d2cc0dcbf1a0 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:55.734907 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-93ae8758-fc76-421e-b0f8-d2cc0dcbf1a0 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:55.735343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-93ae8758-fc76-421e-b0f8-d2cc0dcbf1a0 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:55.736081 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-93ae8758-fc76-421e-b0f8-d2cc0dcbf1a0 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:55.736597 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-93ae8758-fc76-421e-b0f8-d2cc0dcbf1a0 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:55.736989 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-93ae8758-fc76-421e-b0f8-d2cc0dcbf1a0 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:55.870886 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-93ae8758-fc76-421e-b0f8-d2cc0dcbf1a0 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:55.882945 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-93ae8758-fc76-421e-b0f8-d2cc0dcbf1a0 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1515 microversion: 2.1 time: 0.159904 Sep 09 23:21:55.888229 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 68/112] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:55 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:55.912858 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-563f3bf1-393c-499c-8a0b-2b02e54ea1d5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:55.915575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-563f3bf1-393c-499c-8a0b-2b02e54ea1d5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:55.921488 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-563f3bf1-393c-499c-8a0b-2b02e54ea1d5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:55.922065 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-563f3bf1-393c-499c-8a0b-2b02e54ea1d5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:55.922563 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-563f3bf1-393c-499c-8a0b-2b02e54ea1d5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:55.923257 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-563f3bf1-393c-499c-8a0b-2b02e54ea1d5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:55.923711 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-563f3bf1-393c-499c-8a0b-2b02e54ea1d5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:55.924127 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-563f3bf1-393c-499c-8a0b-2b02e54ea1d5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:56.001629 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-563f3bf1-393c-499c-8a0b-2b02e54ea1d5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lazy-loading 'flavor' on Instance uuid a719e8e5-c9aa-4e96-ba41-eae5881e5b06 {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:21:56.064744 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=100 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:21:56.235522 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-2368964f-e075-46c5-b113-e3e0bd0aba40 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6bc8fa4-99a7-43d5-abad-5bd0299f9e14"}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:56.238847 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-2368964f-e075-46c5-b113-e3e0bd0aba40 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:56.244357 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2368964f-e075-46c5-b113-e3e0bd0aba40 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:56.244846 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2368964f-e075-46c5-b113-e3e0bd0aba40 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:56.245392 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2368964f-e075-46c5-b113-e3e0bd0aba40 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:56.246093 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2368964f-e075-46c5-b113-e3e0bd0aba40 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:56.246572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2368964f-e075-46c5-b113-e3e0bd0aba40 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:56.247069 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2368964f-e075-46c5-b113-e3e0bd0aba40 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:56.412495 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-563f3bf1-393c-499c-8a0b-2b02e54ea1d5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "POST /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06/action" status: 200 len: 32 microversion: 2.1 time: 0.504185 Sep 09 23:21:56.413343 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 45/113] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 23:21:55 2022] POST /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06/action => generated 32 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:21:56.423977 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1cca2c85-fb79-4735-931d-c2818b4b9d6a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:56.424684 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-1cca2c85-fb79-4735-931d-c2818b4b9d6a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:56.431844 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1cca2c85-fb79-4735-931d-c2818b4b9d6a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:56.432514 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1cca2c85-fb79-4735-931d-c2818b4b9d6a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:56.432961 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1cca2c85-fb79-4735-931d-c2818b4b9d6a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:56.433665 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1cca2c85-fb79-4735-931d-c2818b4b9d6a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:56.434131 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1cca2c85-fb79-4735-931d-c2818b4b9d6a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:56.434585 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1cca2c85-fb79-4735-931d-c2818b4b9d6a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:56.674792 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1cca2c85-fb79-4735-931d-c2818b4b9d6a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:56.682759 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-1cca2c85-fb79-4735-931d-c2818b4b9d6a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.263122 Sep 09 23:21:56.686769 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 46/114] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:56 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:21:56.701827 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-cbca8e10-6dfd-4927-a3d1-2aa085149155 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:56.704559 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-cbca8e10-6dfd-4927-a3d1-2aa085149155 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:56.708866 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cbca8e10-6dfd-4927-a3d1-2aa085149155 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:56.709340 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cbca8e10-6dfd-4927-a3d1-2aa085149155 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:56.709774 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cbca8e10-6dfd-4927-a3d1-2aa085149155 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:56.710483 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cbca8e10-6dfd-4927-a3d1-2aa085149155 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:56.710934 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cbca8e10-6dfd-4927-a3d1-2aa085149155 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:56.711354 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cbca8e10-6dfd-4927-a3d1-2aa085149155 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:56.779572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-cbca8e10-6dfd-4927-a3d1-2aa085149155 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:56.788417 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-cbca8e10-6dfd-4927-a3d1-2aa085149155 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1271 microversion: 2.1 time: 0.100610 Sep 09 23:21:56.807749 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 47/115] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:56 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:56.807749 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3856c59c-a9c1-470d-a798-af1e8b1dba41 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:56.808155 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3856c59c-a9c1-470d-a798-af1e8b1dba41 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:56.816543 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3856c59c-a9c1-470d-a798-af1e8b1dba41 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:56.817024 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3856c59c-a9c1-470d-a798-af1e8b1dba41 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:56.817446 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3856c59c-a9c1-470d-a798-af1e8b1dba41 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:56.818144 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3856c59c-a9c1-470d-a798-af1e8b1dba41 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:56.818611 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3856c59c-a9c1-470d-a798-af1e8b1dba41 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:56.819032 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3856c59c-a9c1-470d-a798-af1e8b1dba41 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:57.100580 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3856c59c-a9c1-470d-a798-af1e8b1dba41 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:57.108834 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3856c59c-a9c1-470d-a798-af1e8b1dba41 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1549 microversion: 2.1 time: 0.304911 Sep 09 23:21:57.109933 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 48/116] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:56 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1549 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:57.144525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-21ad995d-d467-410b-915a-63f1bf7b451b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:57.145077 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-21ad995d-d467-410b-915a-63f1bf7b451b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:57.151039 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-21ad995d-d467-410b-915a-63f1bf7b451b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:57.151513 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-21ad995d-d467-410b-915a-63f1bf7b451b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:57.152226 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-21ad995d-d467-410b-915a-63f1bf7b451b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:57.153124 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-21ad995d-d467-410b-915a-63f1bf7b451b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:57.153782 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-21ad995d-d467-410b-915a-63f1bf7b451b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:57.154370 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-21ad995d-d467-410b-915a-63f1bf7b451b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:57.315966 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-21ad995d-d467-410b-915a-63f1bf7b451b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.186056 Sep 09 23:21:57.316579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 49/117] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 23:21:57 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:57.706281 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7322dfbd-063e-4cc7-9cc2-e644cd294a38 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:57.708499 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7322dfbd-063e-4cc7-9cc2-e644cd294a38 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:57.720702 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7322dfbd-063e-4cc7-9cc2-e644cd294a38 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:57.724348 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7322dfbd-063e-4cc7-9cc2-e644cd294a38 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:57.725096 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7322dfbd-063e-4cc7-9cc2-e644cd294a38 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:57.726550 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7322dfbd-063e-4cc7-9cc2-e644cd294a38 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:57.727238 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7322dfbd-063e-4cc7-9cc2-e644cd294a38 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:57.727728 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7322dfbd-063e-4cc7-9cc2-e644cd294a38 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:57.843365 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-2368964f-e075-46c5-b113-e3e0bd0aba40 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "POST /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.597668 Sep 09 23:21:57.849886 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 69/118] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 23:21:56 2022] POST /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b/os-volume_attachments => generated 194 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:21:57.861896 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-2c9638fc-6204-458b-bc9c-4435141152f3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:57.862788 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-2c9638fc-6204-458b-bc9c-4435141152f3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:57.871395 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2c9638fc-6204-458b-bc9c-4435141152f3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:57.871879 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2c9638fc-6204-458b-bc9c-4435141152f3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:57.872302 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2c9638fc-6204-458b-bc9c-4435141152f3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:57.873788 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2c9638fc-6204-458b-bc9c-4435141152f3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:57.874435 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2c9638fc-6204-458b-bc9c-4435141152f3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:57.875794 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2c9638fc-6204-458b-bc9c-4435141152f3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:57.976030 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-2c9638fc-6204-458b-bc9c-4435141152f3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:58.000995 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-2c9638fc-6204-458b-bc9c-4435141152f3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1277 microversion: 2.1 time: 0.142516 Sep 09 23:21:58.007332 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 70/119] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:57 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:58.148588 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7322dfbd-063e-4cc7-9cc2-e644cd294a38 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:58.162628 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7322dfbd-063e-4cc7-9cc2-e644cd294a38 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.461205 Sep 09 23:21:58.163389 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 50/120] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:57 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:21:59.027048 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-19636aa3-c234-4da3-bc76-adabda85a95d tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:59.031823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-19636aa3-c234-4da3-bc76-adabda85a95d tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:59.036051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-19636aa3-c234-4da3-bc76-adabda85a95d tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:59.038014 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-19636aa3-c234-4da3-bc76-adabda85a95d tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:59.039631 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-19636aa3-c234-4da3-bc76-adabda85a95d tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:59.041113 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-19636aa3-c234-4da3-bc76-adabda85a95d tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:59.041578 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-19636aa3-c234-4da3-bc76-adabda85a95d tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:59.042250 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-19636aa3-c234-4da3-bc76-adabda85a95d tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:59.188556 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e9b32bc2-c342-4940-a6f2-bbf802317dbc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:21:59.190006 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e9b32bc2-c342-4940-a6f2-bbf802317dbc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:21:59.196302 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e9b32bc2-c342-4940-a6f2-bbf802317dbc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:59.197090 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e9b32bc2-c342-4940-a6f2-bbf802317dbc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:59.197704 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e9b32bc2-c342-4940-a6f2-bbf802317dbc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:59.198776 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e9b32bc2-c342-4940-a6f2-bbf802317dbc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:59.199454 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e9b32bc2-c342-4940-a6f2-bbf802317dbc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:59.200087 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e9b32bc2-c342-4940-a6f2-bbf802317dbc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:59.232344 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-19636aa3-c234-4da3-bc76-adabda85a95d tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:59.266624 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-19636aa3-c234-4da3-bc76-adabda85a95d tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.244447 Sep 09 23:21:59.267217 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 71/121] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:59 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:21:59.685340 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e9b32bc2-c342-4940-a6f2-bbf802317dbc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:21:59.697167 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e9b32bc2-c342-4940-a6f2-bbf802317dbc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.512570 Sep 09 23:21:59.698699 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 51/122] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:21:59 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:21:59.832907 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-147701b5-43c2-43c6-98d0-051096726ba4 req-48e37f91-f1c6-4ed8-b3b9-f9f9e9be87d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0083662b-22d2-4477-af67-902c53f634a1", "tag": "53c6df5b-659f-4e54-8526-ec81f3cbe286"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:59.856721 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-147701b5-43c2-43c6-98d0-051096726ba4 req-48e37f91-f1c6-4ed8-b3b9-f9f9e9be87d2 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:59.857441 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-147701b5-43c2-43c6-98d0-051096726ba4 req-48e37f91-f1c6-4ed8-b3b9-f9f9e9be87d2 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:59.857984 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-147701b5-43c2-43c6-98d0-051096726ba4 req-48e37f91-f1c6-4ed8-b3b9-f9f9e9be87d2 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:59.873872 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-147701b5-43c2-43c6-98d0-051096726ba4 req-48e37f91-f1c6-4ed8-b3b9-f9f9e9be87d2 service nova] Creating event network-changed:53c6df5b-659f-4e54-8526-ec81f3cbe286 for instance 0083662b-22d2-4477-af67-902c53f634a1 on hv-cinder-85032 Sep 09 23:21:59.891699 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-b6cd7a47-39e9-4b99-a58d-79e19eba54ba req-f7837f69-7eed-4a6d-9c55-f505d2cd7fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e56bd49b-8d5d-4de6-a394-2d097824a7c4", "tag": "b86274a6-1ece-499f-902e-c213794d1b58"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:21:59.900680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-147701b5-43c2-43c6-98d0-051096726ba4 req-48e37f91-f1c6-4ed8-b3b9-f9f9e9be87d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057516 Sep 09 23:21:59.900680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 72/123] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:21:59.910685 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-b6cd7a47-39e9-4b99-a58d-79e19eba54ba req-f7837f69-7eed-4a6d-9c55-f505d2cd7fc0 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:21:59.911191 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-b6cd7a47-39e9-4b99-a58d-79e19eba54ba req-f7837f69-7eed-4a6d-9c55-f505d2cd7fc0 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:21:59.911617 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-b6cd7a47-39e9-4b99-a58d-79e19eba54ba req-f7837f69-7eed-4a6d-9c55-f505d2cd7fc0 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:21:59.928709 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-b6cd7a47-39e9-4b99-a58d-79e19eba54ba req-f7837f69-7eed-4a6d-9c55-f505d2cd7fc0 service nova] Creating event network-changed:b86274a6-1ece-499f-902e-c213794d1b58 for instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 on hv-cinder-85032 Sep 09 23:21:59.934601 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-b6cd7a47-39e9-4b99-a58d-79e19eba54ba req-f7837f69-7eed-4a6d-9c55-f505d2cd7fc0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049167 Sep 09 23:21:59.935197 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 52/124] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:22:00.299707 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8872f8af-5133-487c-b0e0-b2f128c11873 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:00.300457 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8872f8af-5133-487c-b0e0-b2f128c11873 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:00.320543 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8872f8af-5133-487c-b0e0-b2f128c11873 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:00.321099 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8872f8af-5133-487c-b0e0-b2f128c11873 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:00.321473 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8872f8af-5133-487c-b0e0-b2f128c11873 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:00.324726 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8872f8af-5133-487c-b0e0-b2f128c11873 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:00.325249 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8872f8af-5133-487c-b0e0-b2f128c11873 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:00.328123 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8872f8af-5133-487c-b0e0-b2f128c11873 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:00.725019 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-383608d1-eba4-428e-9705-e17573d511c7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:00.725799 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-383608d1-eba4-428e-9705-e17573d511c7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:00.739351 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-383608d1-eba4-428e-9705-e17573d511c7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:00.740146 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-383608d1-eba4-428e-9705-e17573d511c7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:00.740822 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-383608d1-eba4-428e-9705-e17573d511c7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:00.741781 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-383608d1-eba4-428e-9705-e17573d511c7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:00.742516 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-383608d1-eba4-428e-9705-e17573d511c7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:00.743141 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-383608d1-eba4-428e-9705-e17573d511c7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:00.847239 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8872f8af-5133-487c-b0e0-b2f128c11873 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:00.863097 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8872f8af-5133-487c-b0e0-b2f128c11873 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.568718 Sep 09 23:22:00.864313 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 73/125] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:00 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1319 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:01.011195 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-383608d1-eba4-428e-9705-e17573d511c7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:01.019555 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-383608d1-eba4-428e-9705-e17573d511c7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.299034 Sep 09 23:22:01.020631 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 53/126] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:00 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:22:01.889299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-6c836697-3e12-4939-bd37-e2c9d3659fe1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:01.890568 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-6c836697-3e12-4939-bd37-e2c9d3659fe1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:01.899432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6c836697-3e12-4939-bd37-e2c9d3659fe1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:01.899986 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6c836697-3e12-4939-bd37-e2c9d3659fe1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:01.902120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6c836697-3e12-4939-bd37-e2c9d3659fe1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:01.902120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6c836697-3e12-4939-bd37-e2c9d3659fe1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:01.902120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6c836697-3e12-4939-bd37-e2c9d3659fe1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:01.902120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6c836697-3e12-4939-bd37-e2c9d3659fe1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:02.045281 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b8a5b5eb-725e-43b8-b3ca-d339ab0a6c93 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:02.046764 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b8a5b5eb-725e-43b8-b3ca-d339ab0a6c93 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:02.053593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-6c836697-3e12-4939-bd37-e2c9d3659fe1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:02.054783 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b8a5b5eb-725e-43b8-b3ca-d339ab0a6c93 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:02.055433 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b8a5b5eb-725e-43b8-b3ca-d339ab0a6c93 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:02.056022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b8a5b5eb-725e-43b8-b3ca-d339ab0a6c93 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:02.056885 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b8a5b5eb-725e-43b8-b3ca-d339ab0a6c93 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:02.057346 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b8a5b5eb-725e-43b8-b3ca-d339ab0a6c93 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:02.057771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b8a5b5eb-725e-43b8-b3ca-d339ab0a6c93 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:02.061702 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-6c836697-3e12-4939-bd37-e2c9d3659fe1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.176580 Sep 09 23:22:02.062849 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 74/127] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:01 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:02.208818 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b8a5b5eb-725e-43b8-b3ca-d339ab0a6c93 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:02.217093 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b8a5b5eb-725e-43b8-b3ca-d339ab0a6c93 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.176862 Sep 09 23:22:02.217709 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 54/128] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:02 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:03.085377 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d2ac33b5-22a2-4642-b6cf-4b827a30cecf tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:03.085997 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d2ac33b5-22a2-4642-b6cf-4b827a30cecf tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:03.092493 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2ac33b5-22a2-4642-b6cf-4b827a30cecf tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:03.093025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2ac33b5-22a2-4642-b6cf-4b827a30cecf tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:03.093529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2ac33b5-22a2-4642-b6cf-4b827a30cecf tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:03.095447 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2ac33b5-22a2-4642-b6cf-4b827a30cecf tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:03.095902 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2ac33b5-22a2-4642-b6cf-4b827a30cecf tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:03.096339 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2ac33b5-22a2-4642-b6cf-4b827a30cecf tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:03.241407 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-71e76eb6-94d6-4f6c-bc1e-0b89d8056adf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:03.242617 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-71e76eb6-94d6-4f6c-bc1e-0b89d8056adf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:03.243975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d2ac33b5-22a2-4642-b6cf-4b827a30cecf tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:03.244821 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=2 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:03.249909 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71e76eb6-94d6-4f6c-bc1e-0b89d8056adf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:03.250493 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71e76eb6-94d6-4f6c-bc1e-0b89d8056adf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:03.250949 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71e76eb6-94d6-4f6c-bc1e-0b89d8056adf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:03.251656 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71e76eb6-94d6-4f6c-bc1e-0b89d8056adf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:03.252115 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71e76eb6-94d6-4f6c-bc1e-0b89d8056adf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:03.252542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71e76eb6-94d6-4f6c-bc1e-0b89d8056adf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:03.252671 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d2ac33b5-22a2-4642-b6cf-4b827a30cecf tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.171097 Sep 09 23:22:03.253242 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 75/129] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:03 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:03.388753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-71e76eb6-94d6-4f6c-bc1e-0b89d8056adf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:03.397075 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-71e76eb6-94d6-4f6c-bc1e-0b89d8056adf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.159723 Sep 09 23:22:03.397656 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 55/130] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:03 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:22:04.277093 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7b7a6a7b-f6ff-487c-b800-655fe42419e3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:04.278227 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7b7a6a7b-f6ff-487c-b800-655fe42419e3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:04.284460 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=2 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:04.286600 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7b7a6a7b-f6ff-487c-b800-655fe42419e3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:04.287270 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7b7a6a7b-f6ff-487c-b800-655fe42419e3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:04.287697 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7b7a6a7b-f6ff-487c-b800-655fe42419e3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:04.288532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7b7a6a7b-f6ff-487c-b800-655fe42419e3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:04.289146 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7b7a6a7b-f6ff-487c-b800-655fe42419e3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:04.289561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7b7a6a7b-f6ff-487c-b800-655fe42419e3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:04.425402 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-40d8053d-f1f0-4d0e-abc1-0141e9a9602c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:04.426682 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-40d8053d-f1f0-4d0e-abc1-0141e9a9602c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:04.434736 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-40d8053d-f1f0-4d0e-abc1-0141e9a9602c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:04.435219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-40d8053d-f1f0-4d0e-abc1-0141e9a9602c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:04.435657 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-40d8053d-f1f0-4d0e-abc1-0141e9a9602c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:04.436351 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-40d8053d-f1f0-4d0e-abc1-0141e9a9602c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:04.436799 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-40d8053d-f1f0-4d0e-abc1-0141e9a9602c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:04.440131 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-40d8053d-f1f0-4d0e-abc1-0141e9a9602c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:04.453028 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7b7a6a7b-f6ff-487c-b800-655fe42419e3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:04.462920 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7b7a6a7b-f6ff-487c-b800-655fe42419e3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.189167 Sep 09 23:22:04.463528 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 76/131] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:04 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:04.464649 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=8 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:04.681579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-40d8053d-f1f0-4d0e-abc1-0141e9a9602c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:04.708456 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-40d8053d-f1f0-4d0e-abc1-0141e9a9602c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.289300 Sep 09 23:22:04.711344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 56/132] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:04 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:05.489569 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fb08c06a-f1d5-4d94-90ad-c553d42df02c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:05.490837 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-fb08c06a-f1d5-4d94-90ad-c553d42df02c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:05.498579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb08c06a-f1d5-4d94-90ad-c553d42df02c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:05.499531 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb08c06a-f1d5-4d94-90ad-c553d42df02c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:05.499971 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb08c06a-f1d5-4d94-90ad-c553d42df02c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:05.501696 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb08c06a-f1d5-4d94-90ad-c553d42df02c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:05.502374 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb08c06a-f1d5-4d94-90ad-c553d42df02c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:05.502970 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb08c06a-f1d5-4d94-90ad-c553d42df02c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:05.662703 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fb08c06a-f1d5-4d94-90ad-c553d42df02c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:05.672096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-fb08c06a-f1d5-4d94-90ad-c553d42df02c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.187295 Sep 09 23:22:05.698918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 77/133] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:05 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:05.733666 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-d41d5a82-4c87-4b79-b20b-070205df1018 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:05.738203 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-d41d5a82-4c87-4b79-b20b-070205df1018 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:05.741047 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d41d5a82-4c87-4b79-b20b-070205df1018 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:05.741527 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d41d5a82-4c87-4b79-b20b-070205df1018 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:05.741958 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d41d5a82-4c87-4b79-b20b-070205df1018 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:05.742678 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d41d5a82-4c87-4b79-b20b-070205df1018 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:05.743158 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d41d5a82-4c87-4b79-b20b-070205df1018 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:05.743577 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d41d5a82-4c87-4b79-b20b-070205df1018 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:05.893511 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d41d5a82-4c87-4b79-b20b-070205df1018 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:05.902090 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-d41d5a82-4c87-4b79-b20b-070205df1018 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.173190 Sep 09 23:22:05.902779 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 57/134] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:05 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:06.700144 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-aa7215c5-3827-4b4f-8c3a-cd3bf80946d1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:06.700764 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-aa7215c5-3827-4b4f-8c3a-cd3bf80946d1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:06.708368 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa7215c5-3827-4b4f-8c3a-cd3bf80946d1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:06.708995 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa7215c5-3827-4b4f-8c3a-cd3bf80946d1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:06.709435 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa7215c5-3827-4b4f-8c3a-cd3bf80946d1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:06.710139 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa7215c5-3827-4b4f-8c3a-cd3bf80946d1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:06.710695 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa7215c5-3827-4b4f-8c3a-cd3bf80946d1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:06.711129 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa7215c5-3827-4b4f-8c3a-cd3bf80946d1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:06.872014 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-aa7215c5-3827-4b4f-8c3a-cd3bf80946d1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:06.882655 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-aa7215c5-3827-4b4f-8c3a-cd3bf80946d1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.184616 Sep 09 23:22:06.882655 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 78/135] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:06 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:06.910670 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-2c161546-656d-4a21-81bc-954925a16a9e req-88399427-5d41-4dfb-afc3-592ced46d4ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0083662b-22d2-4477-af67-902c53f634a1", "name": "network-vif-plugged", "status": "completed", "tag": "53c6df5b-659f-4e54-8526-ec81f3cbe286"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:22:06.927264 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7a95081c-4b4b-460f-8b19-453ac3c13892 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:06.932413 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7a95081c-4b4b-460f-8b19-453ac3c13892 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:06.934356 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-2c161546-656d-4a21-81bc-954925a16a9e req-88399427-5d41-4dfb-afc3-592ced46d4ae service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:06.936438 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7a95081c-4b4b-460f-8b19-453ac3c13892 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:06.937004 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-2c161546-656d-4a21-81bc-954925a16a9e req-88399427-5d41-4dfb-afc3-592ced46d4ae service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:06.937862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-2c161546-656d-4a21-81bc-954925a16a9e req-88399427-5d41-4dfb-afc3-592ced46d4ae service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:06.941179 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7a95081c-4b4b-460f-8b19-453ac3c13892 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:06.942442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7a95081c-4b4b-460f-8b19-453ac3c13892 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:06.943365 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7a95081c-4b4b-460f-8b19-453ac3c13892 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:06.944003 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7a95081c-4b4b-460f-8b19-453ac3c13892 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:06.945550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7a95081c-4b4b-460f-8b19-453ac3c13892 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:06.969613 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-2c161546-656d-4a21-81bc-954925a16a9e req-88399427-5d41-4dfb-afc3-592ced46d4ae service nova] Creating event network-vif-plugged:53c6df5b-659f-4e54-8526-ec81f3cbe286 for instance 0083662b-22d2-4477-af67-902c53f634a1 on hv-cinder-85032 Sep 09 23:22:06.977592 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-2c161546-656d-4a21-81bc-954925a16a9e req-88399427-5d41-4dfb-afc3-592ced46d4ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071542 Sep 09 23:22:06.978195 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 58/136] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:22:07.026259 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-df6069d0-21e7-4904-86a7-de460100163c tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:07.027247 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-df6069d0-21e7-4904-86a7-de460100163c tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:07.039536 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-df6069d0-21e7-4904-86a7-de460100163c tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:07.040642 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-df6069d0-21e7-4904-86a7-de460100163c tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:07.052261 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-df6069d0-21e7-4904-86a7-de460100163c tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:07.052261 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-df6069d0-21e7-4904-86a7-de460100163c tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:07.052261 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-df6069d0-21e7-4904-86a7-de460100163c tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:07.052261 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-df6069d0-21e7-4904-86a7-de460100163c tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:07.096677 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-df6069d0-21e7-4904-86a7-de460100163c tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Going to try to terminate instance {{(pid=121058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:22:07.121644 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7a95081c-4b4b-460f-8b19-453ac3c13892 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:07.138744 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7a95081c-4b4b-460f-8b19-453ac3c13892 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.209573 Sep 09 23:22:07.138744 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 79/137] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:06 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:22:07.540504 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-df6069d0-21e7-4904-86a7-de460100163c tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "DELETE /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 204 len: 0 microversion: 2.1 time: 0.514688 Sep 09 23:22:07.540504 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 59/138] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:22:07 2022] DELETE /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 23:22:07.546256 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-26fdb420-f586-45f4-a5b6-ca96ddb9d962 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:07.547555 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-26fdb420-f586-45f4-a5b6-ca96ddb9d962 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:07.554271 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-26fdb420-f586-45f4-a5b6-ca96ddb9d962 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:07.554575 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-26fdb420-f586-45f4-a5b6-ca96ddb9d962 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:07.555078 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-26fdb420-f586-45f4-a5b6-ca96ddb9d962 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:07.555852 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-26fdb420-f586-45f4-a5b6-ca96ddb9d962 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:07.556398 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-26fdb420-f586-45f4-a5b6-ca96ddb9d962 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:07.556987 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-26fdb420-f586-45f4-a5b6-ca96ddb9d962 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:07.687580 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-26fdb420-f586-45f4-a5b6-ca96ddb9d962 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:07.696549 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-26fdb420-f586-45f4-a5b6-ca96ddb9d962 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1555 microversion: 2.1 time: 0.154074 Sep 09 23:22:07.697222 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 80/139] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:07 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:07.906035 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3bbda65e-e058-46fc-92e7-eff49323cfc3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:07.907392 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3bbda65e-e058-46fc-92e7-eff49323cfc3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:07.913636 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3bbda65e-e058-46fc-92e7-eff49323cfc3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:07.914252 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3bbda65e-e058-46fc-92e7-eff49323cfc3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:07.914558 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3bbda65e-e058-46fc-92e7-eff49323cfc3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:07.915420 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3bbda65e-e058-46fc-92e7-eff49323cfc3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:07.916027 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3bbda65e-e058-46fc-92e7-eff49323cfc3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:07.916445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3bbda65e-e058-46fc-92e7-eff49323cfc3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:08.099610 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3bbda65e-e058-46fc-92e7-eff49323cfc3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:08.101889 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:08.108854 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3bbda65e-e058-46fc-92e7-eff49323cfc3 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.206993 Sep 09 23:22:08.109507 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 60/140] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:07 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:08.158718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-18ade273-9d51-418f-8820-7426fb9c8600 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:08.159464 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-18ade273-9d51-418f-8820-7426fb9c8600 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:08.166072 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-18ade273-9d51-418f-8820-7426fb9c8600 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:08.166507 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-18ade273-9d51-418f-8820-7426fb9c8600 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:08.166939 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-18ade273-9d51-418f-8820-7426fb9c8600 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:08.167744 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-18ade273-9d51-418f-8820-7426fb9c8600 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:08.168063 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-18ade273-9d51-418f-8820-7426fb9c8600 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:08.168477 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-18ade273-9d51-418f-8820-7426fb9c8600 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:08.340985 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-18ade273-9d51-418f-8820-7426fb9c8600 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:08.345781 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:08.366424 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-18ade273-9d51-418f-8820-7426fb9c8600 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.196761 Sep 09 23:22:08.366424 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 81/141] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:08 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:08.721605 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ad0b9b09-0755-4d5a-9e43-decf18974a3b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:08.722224 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ad0b9b09-0755-4d5a-9e43-decf18974a3b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:08.730007 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ad0b9b09-0755-4d5a-9e43-decf18974a3b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:08.730893 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ad0b9b09-0755-4d5a-9e43-decf18974a3b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:08.731406 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ad0b9b09-0755-4d5a-9e43-decf18974a3b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:08.732325 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ad0b9b09-0755-4d5a-9e43-decf18974a3b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:08.732992 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ad0b9b09-0755-4d5a-9e43-decf18974a3b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:08.733563 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ad0b9b09-0755-4d5a-9e43-decf18974a3b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:08.893646 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ad0b9b09-0755-4d5a-9e43-decf18974a3b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:08.902542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ad0b9b09-0755-4d5a-9e43-decf18974a3b tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1555 microversion: 2.1 time: 0.185498 Sep 09 23:22:08.903297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 61/142] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:08 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:09.133920 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e9d4f01c-a1a1-4b96-9ca2-2c0d9ac156c5 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:09.138794 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e9d4f01c-a1a1-4b96-9ca2-2c0d9ac156c5 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:09.148311 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9d4f01c-a1a1-4b96-9ca2-2c0d9ac156c5 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:09.148982 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9d4f01c-a1a1-4b96-9ca2-2c0d9ac156c5 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:09.150885 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9d4f01c-a1a1-4b96-9ca2-2c0d9ac156c5 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:09.150885 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9d4f01c-a1a1-4b96-9ca2-2c0d9ac156c5 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:09.151185 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9d4f01c-a1a1-4b96-9ca2-2c0d9ac156c5 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:09.151825 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9d4f01c-a1a1-4b96-9ca2-2c0d9ac156c5 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:09.305688 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e9d4f01c-a1a1-4b96-9ca2-2c0d9ac156c5 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:09.311003 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e9d4f01c-a1a1-4b96-9ca2-2c0d9ac156c5 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.181800 Sep 09 23:22:09.311571 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 82/143] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:09 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:09.376422 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8b8f0126-7366-4c96-99c1-ed12d2f0827b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:09.377654 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8b8f0126-7366-4c96-99c1-ed12d2f0827b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:09.384036 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8b8f0126-7366-4c96-99c1-ed12d2f0827b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:09.385001 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8b8f0126-7366-4c96-99c1-ed12d2f0827b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:09.385628 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8b8f0126-7366-4c96-99c1-ed12d2f0827b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:09.386554 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8b8f0126-7366-4c96-99c1-ed12d2f0827b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:09.387194 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8b8f0126-7366-4c96-99c1-ed12d2f0827b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:09.387678 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8b8f0126-7366-4c96-99c1-ed12d2f0827b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:09.641234 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8b8f0126-7366-4c96-99c1-ed12d2f0827b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:09.652303 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8b8f0126-7366-4c96-99c1-ed12d2f0827b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.281401 Sep 09 23:22:09.652881 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 62/144] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:09 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:09.933905 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-9f117f54-47d0-4ea8-a362-f59e6bbab73d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:09.934974 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-9f117f54-47d0-4ea8-a362-f59e6bbab73d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:09.946523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f117f54-47d0-4ea8-a362-f59e6bbab73d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:09.947334 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f117f54-47d0-4ea8-a362-f59e6bbab73d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:09.947784 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f117f54-47d0-4ea8-a362-f59e6bbab73d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:09.949467 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f117f54-47d0-4ea8-a362-f59e6bbab73d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:09.949901 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f117f54-47d0-4ea8-a362-f59e6bbab73d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:09.950403 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f117f54-47d0-4ea8-a362-f59e6bbab73d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:10.318769 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-9f117f54-47d0-4ea8-a362-f59e6bbab73d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:10.326748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-9f117f54-47d0-4ea8-a362-f59e6bbab73d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1555 microversion: 2.1 time: 0.400722 Sep 09 23:22:10.327429 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 83/145] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:09 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1555 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:10.347713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9fd1e04d-13ca-4460-b422-988401180ac2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:10.348376 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9fd1e04d-13ca-4460-b422-988401180ac2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:10.355025 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9fd1e04d-13ca-4460-b422-988401180ac2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:10.355515 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9fd1e04d-13ca-4460-b422-988401180ac2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:10.355952 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9fd1e04d-13ca-4460-b422-988401180ac2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:10.356648 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9fd1e04d-13ca-4460-b422-988401180ac2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:10.357105 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9fd1e04d-13ca-4460-b422-988401180ac2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:10.357603 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9fd1e04d-13ca-4460-b422-988401180ac2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:10.559579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9fd1e04d-13ca-4460-b422-988401180ac2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:10.569752 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9fd1e04d-13ca-4460-b422-988401180ac2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1509 microversion: 2.1 time: 0.226008 Sep 09 23:22:10.570366 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 63/146] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:10 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:10.678298 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-951b3b2b-529e-496b-9360-a91cbb60e06a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:10.678834 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-951b3b2b-529e-496b-9360-a91cbb60e06a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:10.698838 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-951b3b2b-529e-496b-9360-a91cbb60e06a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:10.701186 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-951b3b2b-529e-496b-9360-a91cbb60e06a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:10.702699 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-951b3b2b-529e-496b-9360-a91cbb60e06a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:10.709132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-951b3b2b-529e-496b-9360-a91cbb60e06a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:10.709740 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-951b3b2b-529e-496b-9360-a91cbb60e06a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:10.714603 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-951b3b2b-529e-496b-9360-a91cbb60e06a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:11.141605 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-951b3b2b-529e-496b-9360-a91cbb60e06a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:11.156976 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-951b3b2b-529e-496b-9360-a91cbb60e06a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.481193 Sep 09 23:22:11.159930 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 84/147] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:10 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:11.351405 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c7ac4dda-097e-4daa-a2fc-bfff3797450d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:11.352944 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c7ac4dda-097e-4daa-a2fc-bfff3797450d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:11.360725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c7ac4dda-097e-4daa-a2fc-bfff3797450d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:11.362359 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c7ac4dda-097e-4daa-a2fc-bfff3797450d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:11.363251 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c7ac4dda-097e-4daa-a2fc-bfff3797450d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:11.374954 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c7ac4dda-097e-4daa-a2fc-bfff3797450d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:11.377710 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c7ac4dda-097e-4daa-a2fc-bfff3797450d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:11.380035 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c7ac4dda-097e-4daa-a2fc-bfff3797450d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:11.516750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c7ac4dda-097e-4daa-a2fc-bfff3797450d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:11.528214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c7ac4dda-097e-4daa-a2fc-bfff3797450d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1513 microversion: 2.1 time: 0.180710 Sep 09 23:22:11.542510 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 64/148] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:11 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:11.565481 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-a14b1b95-5a93-4f2f-87f9-e69d38a5556a req-84d110a7-c966-4f86-99c1-60a631fc62ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98941a2f-f38e-401c-952d-0306b886414b", "name": "network-vif-deleted", "tag": "68303a0a-a147-4bf7-bc4c-c100d86bdfbb"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:22:11.577806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-a14b1b95-5a93-4f2f-87f9-e69d38a5556a req-84d110a7-c966-4f86-99c1-60a631fc62ce service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:11.582661 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-a14b1b95-5a93-4f2f-87f9-e69d38a5556a req-84d110a7-c966-4f86-99c1-60a631fc62ce service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:11.582661 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-a14b1b95-5a93-4f2f-87f9-e69d38a5556a req-84d110a7-c966-4f86-99c1-60a631fc62ce service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:11.596809 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-a14b1b95-5a93-4f2f-87f9-e69d38a5556a req-84d110a7-c966-4f86-99c1-60a631fc62ce service nova] Creating event network-vif-deleted:68303a0a-a147-4bf7-bc4c-c100d86bdfbb for instance 98941a2f-f38e-401c-952d-0306b886414b on hv-cinder-85032 Sep 09 23:22:11.620405 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-a14b1b95-5a93-4f2f-87f9-e69d38a5556a req-84d110a7-c966-4f86-99c1-60a631fc62ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064489 Sep 09 23:22:11.635376 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 85/149] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:22:12.182764 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c999cb2b-5d3d-4efd-be68-bd10b8d2c328 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:12.183424 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c999cb2b-5d3d-4efd-be68-bd10b8d2c328 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:12.190003 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c999cb2b-5d3d-4efd-be68-bd10b8d2c328 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:12.190503 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c999cb2b-5d3d-4efd-be68-bd10b8d2c328 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:12.191425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c999cb2b-5d3d-4efd-be68-bd10b8d2c328 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:12.192104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c999cb2b-5d3d-4efd-be68-bd10b8d2c328 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:12.192554 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c999cb2b-5d3d-4efd-be68-bd10b8d2c328 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:12.192970 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c999cb2b-5d3d-4efd-be68-bd10b8d2c328 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:12.341130 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c999cb2b-5d3d-4efd-be68-bd10b8d2c328 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:12.351925 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c999cb2b-5d3d-4efd-be68-bd10b8d2c328 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.172095 Sep 09 23:22:12.361357 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 65/150] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:12 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:12.573054 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-dffb3b93-e3e9-47b3-bbf7-42c56e384653 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:12.575609 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-dffb3b93-e3e9-47b3-bbf7-42c56e384653 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:12.583782 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dffb3b93-e3e9-47b3-bbf7-42c56e384653 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:12.584492 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dffb3b93-e3e9-47b3-bbf7-42c56e384653 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:12.585172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dffb3b93-e3e9-47b3-bbf7-42c56e384653 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:12.586233 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dffb3b93-e3e9-47b3-bbf7-42c56e384653 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:12.586917 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dffb3b93-e3e9-47b3-bbf7-42c56e384653 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:12.587546 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dffb3b93-e3e9-47b3-bbf7-42c56e384653 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:12.697964 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-dffb3b93-e3e9-47b3-bbf7-42c56e384653 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:12.713207 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-dffb3b93-e3e9-47b3-bbf7-42c56e384653 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1346 microversion: 2.1 time: 0.146331 Sep 09 23:22:12.713844 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 86/151] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:12 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1346 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:13.392617 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7bb8f173-d868-48f7-bbca-6cd25c3c75bc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:13.395321 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7bb8f173-d868-48f7-bbca-6cd25c3c75bc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:13.409521 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:13.414603 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7bb8f173-d868-48f7-bbca-6cd25c3c75bc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:13.421217 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7bb8f173-d868-48f7-bbca-6cd25c3c75bc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:13.421681 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7bb8f173-d868-48f7-bbca-6cd25c3c75bc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:13.423481 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7bb8f173-d868-48f7-bbca-6cd25c3c75bc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:13.430769 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7bb8f173-d868-48f7-bbca-6cd25c3c75bc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:13.432183 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7bb8f173-d868-48f7-bbca-6cd25c3c75bc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:13.616244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7bb8f173-d868-48f7-bbca-6cd25c3c75bc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:13.632418 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7bb8f173-d868-48f7-bbca-6cd25c3c75bc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.248111 Sep 09 23:22:13.644556 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 66/152] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:13 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:13.742110 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-811fc98e-503d-4048-a901-e427fbd6851d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:13.743548 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-811fc98e-503d-4048-a901-e427fbd6851d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:13.752324 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-811fc98e-503d-4048-a901-e427fbd6851d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:13.753113 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-811fc98e-503d-4048-a901-e427fbd6851d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:13.753619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-811fc98e-503d-4048-a901-e427fbd6851d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:13.754414 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-811fc98e-503d-4048-a901-e427fbd6851d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:13.755026 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-811fc98e-503d-4048-a901-e427fbd6851d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:13.755451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-811fc98e-503d-4048-a901-e427fbd6851d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:13.791814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-811fc98e-503d-4048-a901-e427fbd6851d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:13.792505 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-811fc98e-503d-4048-a901-e427fbd6851d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:13.793098 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-811fc98e-503d-4048-a901-e427fbd6851d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:13.793556 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-811fc98e-503d-4048-a901-e427fbd6851d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lazy-loading 'fault' on Instance uuid 98941a2f-f38e-401c-952d-0306b886414b {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:22:13.853831 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-811fc98e-503d-4048-a901-e427fbd6851d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a496b0d69dd24d6980fa7301b7fa2a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4291c4cdc1d4f4eae035c4800670101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:13.881974 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-811fc98e-503d-4048-a901-e427fbd6851d tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 200 len: 1351 microversion: 2.1 time: 0.144306 Sep 09 23:22:13.898543 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 87/153] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:13 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 1351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:22:14.671560 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-2061cfe4-3407-46c0-8ff3-4e5e8e6fbcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:14.672391 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-2061cfe4-3407-46c0-8ff3-4e5e8e6fbcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:14.680088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2061cfe4-3407-46c0-8ff3-4e5e8e6fbcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:14.680088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2061cfe4-3407-46c0-8ff3-4e5e8e6fbcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:14.680535 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2061cfe4-3407-46c0-8ff3-4e5e8e6fbcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:14.681219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2061cfe4-3407-46c0-8ff3-4e5e8e6fbcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:14.681667 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2061cfe4-3407-46c0-8ff3-4e5e8e6fbcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:14.682172 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2061cfe4-3407-46c0-8ff3-4e5e8e6fbcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:14.824810 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-2061cfe4-3407-46c0-8ff3-4e5e8e6fbcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:14.829877 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-2061cfe4-3407-46c0-8ff3-4e5e8e6fbcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.164107 Sep 09 23:22:14.830503 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 67/154] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:14 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:14.909716 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0c49ec7e-6de9-4b66-a26c-281badf611ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:14.912013 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-0c49ec7e-6de9-4b66-a26c-281badf611ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:14.921338 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0c49ec7e-6de9-4b66-a26c-281badf611ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:14.922016 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0c49ec7e-6de9-4b66-a26c-281badf611ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:14.922603 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0c49ec7e-6de9-4b66-a26c-281badf611ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:14.923536 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0c49ec7e-6de9-4b66-a26c-281badf611ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:14.924048 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0c49ec7e-6de9-4b66-a26c-281badf611ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:14.924934 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0c49ec7e-6de9-4b66-a26c-281badf611ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:14.949072 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-0c49ec7e-6de9-4b66-a26c-281badf611ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] HTTP exception thrown: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0c49ec7e-6de9-4b66-a26c-281badf611ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Request method failure captured: Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b HTTP/1.1 Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8pr1dK2kw7miLzml1UFNn3yN5uAwttBBxrAs8dj8gnkEUsrsTp7FNyV-sxcbtPJGaW-6ikYFPsKUtcp3Ytgbh1b0b69WEEjC7W5eXWM2MXr-0szX70mgn6Cg2cC174DDbL8FWdtRuKUXquTjrPTZ55bWQzNVdE-qkWy2bYZSoDn4JQ Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: b4291c4cdc1d4f4eae035c4800670101 Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-DeleteServersTestJSON-2061449202 Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:22:14.962614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:22:14.964031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4291c4cdc1d4f4eae035c4800670101"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b4291c4cdc1d4f4eae035c4800670101"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4291c4cdc1d4f4eae035c4800670101"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b4291c4cdc1d4f4eae035c4800670101", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:22:14.964031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-DeleteServersTestJSON-2061449202 Sep 09 23:22:14.964031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: b4291c4cdc1d4f4eae035c4800670101 Sep 09 23:22:14.964031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-DeleteServersTestJSON-2061449202 Sep 09 23:22:14.964031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-DeleteServersTestJSON-2061449202-project Sep 09 23:22:14.964031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:22:14.964031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:22:14.964031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: a496b0d69dd24d6980fa7301b7fa2a90 Sep 09 23:22:14.964031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-DeleteServersTestJSON-2061449202-project Sep 09 23:22:14.964031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:22:14.964031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:14.964031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '98941a2f-f38e-401c-952d-0306b886414b'} Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:22:14.964887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:14.966381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:22:14.968638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0c49ec7e-6de9-4b66-a26c-281badf611ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Returning 404 to user: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:22:14.969509 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-0c49ec7e-6de9-4b66-a26c-281badf611ee tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 404 len: 111 microversion: 2.1 time: 0.067257 Sep 09 23:22:14.970260 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 88/155] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:14 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:22:15.129588 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-784ca787-ca31-4553-af57-6c032065c205 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:15.132134 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-784ca787-ca31-4553-af57-6c032065c205 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:15.139227 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-784ca787-ca31-4553-af57-6c032065c205 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:15.139955 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-784ca787-ca31-4553-af57-6c032065c205 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:15.141088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-784ca787-ca31-4553-af57-6c032065c205 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:15.142762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-784ca787-ca31-4553-af57-6c032065c205 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:15.143417 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-784ca787-ca31-4553-af57-6c032065c205 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:15.143856 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-784ca787-ca31-4553-af57-6c032065c205 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:15.159820 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-784ca787-ca31-4553-af57-6c032065c205 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] HTTP exception thrown: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-784ca787-ca31-4553-af57-6c032065c205 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Request method failure captured: Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b/os-volume_attachments HTTP/1.1 Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8pr1dK2kw7miLzml1UFNn3yN5uAwttBBxrAs8dj8gnkEUsrsTp7FNyV-sxcbtPJGaW-6ikYFPsKUtcp3Ytgbh1b0b69WEEjC7W5eXWM2MXr-0szX70mgn6Cg2cC174DDbL8FWdtRuKUXquTjrPTZ55bWQzNVdE-qkWy2bYZSoDn4JQ Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: b4291c4cdc1d4f4eae035c4800670101 Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-DeleteServersTestJSON-2061449202 Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:22:15.169936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:22:15.171299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4291c4cdc1d4f4eae035c4800670101"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b4291c4cdc1d4f4eae035c4800670101"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4291c4cdc1d4f4eae035c4800670101"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b4291c4cdc1d4f4eae035c4800670101", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:22:15.171299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-DeleteServersTestJSON-2061449202 Sep 09 23:22:15.171299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: b4291c4cdc1d4f4eae035c4800670101 Sep 09 23:22:15.171299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-DeleteServersTestJSON-2061449202 Sep 09 23:22:15.171299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-DeleteServersTestJSON-2061449202-project Sep 09 23:22:15.171299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:22:15.171299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:22:15.171299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: a496b0d69dd24d6980fa7301b7fa2a90 Sep 09 23:22:15.171299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-DeleteServersTestJSON-2061449202-project Sep 09 23:22:15.171299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:22:15.171299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:15.171299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'server_id': '98941a2f-f38e-401c-952d-0306b886414b'} Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:22:15.172362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:15.174017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:22:15.175448 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-784ca787-ca31-4553-af57-6c032065c205 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Returning 404 to user: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:22:15.175448 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-784ca787-ca31-4553-af57-6c032065c205 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046496 Sep 09 23:22:15.175448 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 68/156] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:22:15 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:22:15.854953 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ff720fc9-9a6b-4244-975b-722fa62e5697 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:15.855740 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ff720fc9-9a6b-4244-975b-722fa62e5697 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:15.880533 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff720fc9-9a6b-4244-975b-722fa62e5697 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:15.881029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff720fc9-9a6b-4244-975b-722fa62e5697 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:15.881458 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff720fc9-9a6b-4244-975b-722fa62e5697 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:15.887439 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff720fc9-9a6b-4244-975b-722fa62e5697 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:15.888063 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff720fc9-9a6b-4244-975b-722fa62e5697 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:15.888647 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff720fc9-9a6b-4244-975b-722fa62e5697 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:16.134742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ff720fc9-9a6b-4244-975b-722fa62e5697 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:16.148027 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ff720fc9-9a6b-4244-975b-722fa62e5697 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.297914 Sep 09 23:22:16.149987 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 89/157] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:15 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:17.175100 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c1428221-2bcd-479a-92fd-e06840fca32a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:17.175712 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c1428221-2bcd-479a-92fd-e06840fca32a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:17.182496 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1428221-2bcd-479a-92fd-e06840fca32a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:17.188059 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1428221-2bcd-479a-92fd-e06840fca32a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:17.188059 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1428221-2bcd-479a-92fd-e06840fca32a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:17.188059 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1428221-2bcd-479a-92fd-e06840fca32a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:17.188059 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1428221-2bcd-479a-92fd-e06840fca32a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:17.188466 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1428221-2bcd-479a-92fd-e06840fca32a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:17.340081 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c1428221-2bcd-479a-92fd-e06840fca32a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:17.363153 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c1428221-2bcd-479a-92fd-e06840fca32a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.191955 Sep 09 23:22:17.368809 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 69/158] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:17 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:17.567313 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4d93c1d4-3635-4e7f-ae0f-7b4f7748c79e tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:17.567824 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4d93c1d4-3635-4e7f-ae0f-7b4f7748c79e tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:17.574041 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4d93c1d4-3635-4e7f-ae0f-7b4f7748c79e tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:17.574948 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4d93c1d4-3635-4e7f-ae0f-7b4f7748c79e tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:17.575911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4d93c1d4-3635-4e7f-ae0f-7b4f7748c79e tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:17.576779 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4d93c1d4-3635-4e7f-ae0f-7b4f7748c79e tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:17.577463 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4d93c1d4-3635-4e7f-ae0f-7b4f7748c79e tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:17.578724 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4d93c1d4-3635-4e7f-ae0f-7b4f7748c79e tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:17.596720 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-4d93c1d4-3635-4e7f-ae0f-7b4f7748c79e tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] HTTP exception thrown: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4d93c1d4-3635-4e7f-ae0f-7b4f7748c79e tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Request method failure captured: Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: DELETE /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b HTTP/1.1 Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8pr1dK2kw7miLzml1UFNn3yN5uAwttBBxrAs8dj8gnkEUsrsTp7FNyV-sxcbtPJGaW-6ikYFPsKUtcp3Ytgbh1b0b69WEEjC7W5eXWM2MXr-0szX70mgn6Cg2cC174DDbL8FWdtRuKUXquTjrPTZ55bWQzNVdE-qkWy2bYZSoDn4JQ Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: b4291c4cdc1d4f4eae035c4800670101 Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-DeleteServersTestJSON-2061449202 Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:22:17.598572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:22:17.600015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4291c4cdc1d4f4eae035c4800670101"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b4291c4cdc1d4f4eae035c4800670101"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4291c4cdc1d4f4eae035c4800670101"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b4291c4cdc1d4f4eae035c4800670101", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:22:17.600015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-DeleteServersTestJSON-2061449202 Sep 09 23:22:17.600015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: b4291c4cdc1d4f4eae035c4800670101 Sep 09 23:22:17.600015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-DeleteServersTestJSON-2061449202 Sep 09 23:22:17.600015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-DeleteServersTestJSON-2061449202-project Sep 09 23:22:17.600015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:22:17.600015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:22:17.600015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: a496b0d69dd24d6980fa7301b7fa2a90 Sep 09 23:22:17.600015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-DeleteServersTestJSON-2061449202-project Sep 09 23:22:17.600015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:22:17.600015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:17.600015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '98941a2f-f38e-401c-952d-0306b886414b'} Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:22:17.600806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:17.602046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:22:17.604112 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4d93c1d4-3635-4e7f-ae0f-7b4f7748c79e tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Returning 404 to user: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:22:17.605403 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4d93c1d4-3635-4e7f-ae0f-7b4f7748c79e tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "DELETE /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 404 len: 111 microversion: 2.1 time: 0.042846 Sep 09 23:22:17.606461 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 90/159] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:22:17 2022] DELETE /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:22:17.617316 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-526b42c4-d257-4011-a0ff-5cddd903fc19 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:17.618597 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-526b42c4-d257-4011-a0ff-5cddd903fc19 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] [instance: 98941a2f-f38e-401c-952d-0306b886414b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:17.627946 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-526b42c4-d257-4011-a0ff-5cddd903fc19 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:17.628579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-526b42c4-d257-4011-a0ff-5cddd903fc19 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:17.629145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-526b42c4-d257-4011-a0ff-5cddd903fc19 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:17.630306 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-526b42c4-d257-4011-a0ff-5cddd903fc19 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:17.631342 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-526b42c4-d257-4011-a0ff-5cddd903fc19 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:17.631946 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-526b42c4-d257-4011-a0ff-5cddd903fc19 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:17.661843 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-526b42c4-d257-4011-a0ff-5cddd903fc19 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] HTTP exception thrown: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-526b42c4-d257-4011-a0ff-5cddd903fc19 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Request method failure captured: Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b HTTP/1.1 Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8pr1dK2kw7miLzml1UFNn3yN5uAwttBBxrAs8dj8gnkEUsrsTp7FNyV-sxcbtPJGaW-6ikYFPsKUtcp3Ytgbh1b0b69WEEjC7W5eXWM2MXr-0szX70mgn6Cg2cC174DDbL8FWdtRuKUXquTjrPTZ55bWQzNVdE-qkWy2bYZSoDn4JQ Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: b4291c4cdc1d4f4eae035c4800670101 Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-DeleteServersTestJSON-2061449202 Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:22:17.664029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:22:17.665289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4291c4cdc1d4f4eae035c4800670101"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b4291c4cdc1d4f4eae035c4800670101"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4291c4cdc1d4f4eae035c4800670101"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b4291c4cdc1d4f4eae035c4800670101", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:22:17.665289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-DeleteServersTestJSON-2061449202 Sep 09 23:22:17.665289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: b4291c4cdc1d4f4eae035c4800670101 Sep 09 23:22:17.665289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-DeleteServersTestJSON-2061449202 Sep 09 23:22:17.665289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-DeleteServersTestJSON-2061449202-project Sep 09 23:22:17.665289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:22:17.665289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:22:17.665289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: a496b0d69dd24d6980fa7301b7fa2a90 Sep 09 23:22:17.665289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-DeleteServersTestJSON-2061449202-project Sep 09 23:22:17.665289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:22:17.665289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:17.665289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '98941a2f-f38e-401c-952d-0306b886414b'} Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:22:17.666145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. Sep 09 23:22:17.667219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:22:17.669119 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-526b42c4-d257-4011-a0ff-5cddd903fc19 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] Returning 404 to user: Instance 98941a2f-f38e-401c-952d-0306b886414b could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:22:17.669119 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-526b42c4-d257-4011-a0ff-5cddd903fc19 tempest-DeleteServersTestJSON-2061449202 tempest-DeleteServersTestJSON-2061449202-project] 10.222.0.20 "GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b" status: 404 len: 111 microversion: 2.1 time: 0.055230 Sep 09 23:22:17.669119 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 70/160] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:17 2022] GET /compute/v2.1/servers/98941a2f-f38e-401c-952d-0306b886414b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:22:18.393321 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b864d37e-0306-4e01-b43c-8839d82c8aba tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:18.393979 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b864d37e-0306-4e01-b43c-8839d82c8aba tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:18.400870 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b864d37e-0306-4e01-b43c-8839d82c8aba tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:18.401452 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b864d37e-0306-4e01-b43c-8839d82c8aba tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:18.401893 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b864d37e-0306-4e01-b43c-8839d82c8aba tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:18.402663 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b864d37e-0306-4e01-b43c-8839d82c8aba tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:18.403113 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b864d37e-0306-4e01-b43c-8839d82c8aba tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:18.403763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b864d37e-0306-4e01-b43c-8839d82c8aba tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:18.664805 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b864d37e-0306-4e01-b43c-8839d82c8aba tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:18.674400 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b864d37e-0306-4e01-b43c-8839d82c8aba tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.285588 Sep 09 23:22:18.686948 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 91/161] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:18 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:19.700016 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-adb88bec-6ac6-4fbd-ac4c-993ebe2ec85a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:19.701665 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-adb88bec-6ac6-4fbd-ac4c-993ebe2ec85a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:19.721023 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-adb88bec-6ac6-4fbd-ac4c-993ebe2ec85a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:19.721765 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-adb88bec-6ac6-4fbd-ac4c-993ebe2ec85a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:19.722661 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-adb88bec-6ac6-4fbd-ac4c-993ebe2ec85a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:19.723360 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-adb88bec-6ac6-4fbd-ac4c-993ebe2ec85a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:19.724901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-adb88bec-6ac6-4fbd-ac4c-993ebe2ec85a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:19.725411 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-adb88bec-6ac6-4fbd-ac4c-993ebe2ec85a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:20.049279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-adb88bec-6ac6-4fbd-ac4c-993ebe2ec85a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:20.068511 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-adb88bec-6ac6-4fbd-ac4c-993ebe2ec85a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.373589 Sep 09 23:22:20.070964 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 71/162] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:19 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:21.093164 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a6f288de-0758-4154-8ded-fb8f00f4e117 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:21.096211 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a6f288de-0758-4154-8ded-fb8f00f4e117 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:21.104214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a6f288de-0758-4154-8ded-fb8f00f4e117 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:21.105288 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a6f288de-0758-4154-8ded-fb8f00f4e117 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:21.105786 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a6f288de-0758-4154-8ded-fb8f00f4e117 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:21.107189 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a6f288de-0758-4154-8ded-fb8f00f4e117 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:21.107897 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a6f288de-0758-4154-8ded-fb8f00f4e117 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:21.108465 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a6f288de-0758-4154-8ded-fb8f00f4e117 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:21.316031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a6f288de-0758-4154-8ded-fb8f00f4e117 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:21.325108 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a6f288de-0758-4154-8ded-fb8f00f4e117 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.235651 Sep 09 23:22:21.325793 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 92/163] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:21 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:22.351297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-2fe69797-2c0e-46f2-9cd1-c85f11c47555 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:22.351297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-2fe69797-2c0e-46f2-9cd1-c85f11c47555 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:22.359775 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2fe69797-2c0e-46f2-9cd1-c85f11c47555 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:22.360605 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2fe69797-2c0e-46f2-9cd1-c85f11c47555 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:22.361159 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2fe69797-2c0e-46f2-9cd1-c85f11c47555 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:22.362056 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2fe69797-2c0e-46f2-9cd1-c85f11c47555 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:22.362753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2fe69797-2c0e-46f2-9cd1-c85f11c47555 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:22.363633 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2fe69797-2c0e-46f2-9cd1-c85f11c47555 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:22.673858 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-2fe69797-2c0e-46f2-9cd1-c85f11c47555 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:22.686434 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-2fe69797-2c0e-46f2-9cd1-c85f11c47555 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.341911 Sep 09 23:22:22.702770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 72/164] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:22 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:23.712970 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3ffc3b65-6e9c-420a-ab28-36de7b9d1032 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:23.713572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3ffc3b65-6e9c-420a-ab28-36de7b9d1032 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:23.716012 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=82 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:23.720823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ffc3b65-6e9c-420a-ab28-36de7b9d1032 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:23.721304 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ffc3b65-6e9c-420a-ab28-36de7b9d1032 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:23.727109 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ffc3b65-6e9c-420a-ab28-36de7b9d1032 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:23.727109 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ffc3b65-6e9c-420a-ab28-36de7b9d1032 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:23.727109 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ffc3b65-6e9c-420a-ab28-36de7b9d1032 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:23.727109 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ffc3b65-6e9c-420a-ab28-36de7b9d1032 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:23.882746 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3ffc3b65-6e9c-420a-ab28-36de7b9d1032 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:23.890964 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3ffc3b65-6e9c-420a-ab28-36de7b9d1032 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.181194 Sep 09 23:22:23.891541 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 93/165] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:23 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:22:24.915798 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-117c171d-e69d-4fa7-aac2-aaec5a757ff2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:24.917959 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-117c171d-e69d-4fa7-aac2-aaec5a757ff2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:24.926377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-117c171d-e69d-4fa7-aac2-aaec5a757ff2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:24.927410 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-117c171d-e69d-4fa7-aac2-aaec5a757ff2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:24.928015 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-117c171d-e69d-4fa7-aac2-aaec5a757ff2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:24.929081 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-117c171d-e69d-4fa7-aac2-aaec5a757ff2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:24.929888 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-117c171d-e69d-4fa7-aac2-aaec5a757ff2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:24.930498 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-117c171d-e69d-4fa7-aac2-aaec5a757ff2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:25.078460 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-117c171d-e69d-4fa7-aac2-aaec5a757ff2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:25.088045 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-117c171d-e69d-4fa7-aac2-aaec5a757ff2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.177444 Sep 09 23:22:25.088623 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 73/166] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:24 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:26.114493 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-002b2a40-fd21-4b0c-b449-a2fc669d078f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:26.115211 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-002b2a40-fd21-4b0c-b449-a2fc669d078f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:26.122859 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-002b2a40-fd21-4b0c-b449-a2fc669d078f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:26.125744 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-002b2a40-fd21-4b0c-b449-a2fc669d078f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:26.125744 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-002b2a40-fd21-4b0c-b449-a2fc669d078f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:26.126764 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-002b2a40-fd21-4b0c-b449-a2fc669d078f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:26.127217 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-002b2a40-fd21-4b0c-b449-a2fc669d078f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:26.127636 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-002b2a40-fd21-4b0c-b449-a2fc669d078f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:26.311230 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-002b2a40-fd21-4b0c-b449-a2fc669d078f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:26.322814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-002b2a40-fd21-4b0c-b449-a2fc669d078f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.213800 Sep 09 23:22:26.323575 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 94/167] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:26 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:27.347057 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-fbb44a7d-e56a-493b-aea1-53a2533111ab tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:27.347748 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-fbb44a7d-e56a-493b-aea1-53a2533111ab tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:27.354411 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fbb44a7d-e56a-493b-aea1-53a2533111ab tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:27.355275 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fbb44a7d-e56a-493b-aea1-53a2533111ab tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:27.355806 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fbb44a7d-e56a-493b-aea1-53a2533111ab tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:27.356622 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fbb44a7d-e56a-493b-aea1-53a2533111ab tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:27.357175 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fbb44a7d-e56a-493b-aea1-53a2533111ab tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:27.357701 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fbb44a7d-e56a-493b-aea1-53a2533111ab tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:27.528700 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-fbb44a7d-e56a-493b-aea1-53a2533111ab tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:27.537768 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-fbb44a7d-e56a-493b-aea1-53a2533111ab tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.195759 Sep 09 23:22:27.541171 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 74/168] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:27 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:28.568375 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d52142c3-078f-4fce-b3ea-072d4389441d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:28.569075 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d52142c3-078f-4fce-b3ea-072d4389441d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:28.575572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d52142c3-078f-4fce-b3ea-072d4389441d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:28.576158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d52142c3-078f-4fce-b3ea-072d4389441d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:28.576651 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d52142c3-078f-4fce-b3ea-072d4389441d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:28.577749 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d52142c3-078f-4fce-b3ea-072d4389441d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:28.579266 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d52142c3-078f-4fce-b3ea-072d4389441d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:28.579906 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d52142c3-078f-4fce-b3ea-072d4389441d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:28.891698 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d52142c3-078f-4fce-b3ea-072d4389441d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:28.902316 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d52142c3-078f-4fce-b3ea-072d4389441d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.341275 Sep 09 23:22:28.902959 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 95/169] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:28 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:29.926710 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-f0be5221-179f-4ff1-aa18-20cf8e8e9686 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:29.927415 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-f0be5221-179f-4ff1-aa18-20cf8e8e9686 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:29.933821 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0be5221-179f-4ff1-aa18-20cf8e8e9686 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:29.934332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0be5221-179f-4ff1-aa18-20cf8e8e9686 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:29.934786 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0be5221-179f-4ff1-aa18-20cf8e8e9686 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:29.935492 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0be5221-179f-4ff1-aa18-20cf8e8e9686 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:29.935948 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0be5221-179f-4ff1-aa18-20cf8e8e9686 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:29.936375 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0be5221-179f-4ff1-aa18-20cf8e8e9686 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:30.103704 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-f0be5221-179f-4ff1-aa18-20cf8e8e9686 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:30.115280 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-f0be5221-179f-4ff1-aa18-20cf8e8e9686 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.192477 Sep 09 23:22:30.126421 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 75/170] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:29 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:31.142614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-cd13d7aa-9b83-49d4-bdbc-65c576a20068 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:31.143216 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-cd13d7aa-9b83-49d4-bdbc-65c576a20068 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:31.151733 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd13d7aa-9b83-49d4-bdbc-65c576a20068 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:31.152227 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd13d7aa-9b83-49d4-bdbc-65c576a20068 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:31.152667 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd13d7aa-9b83-49d4-bdbc-65c576a20068 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:31.153374 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd13d7aa-9b83-49d4-bdbc-65c576a20068 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:31.153831 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd13d7aa-9b83-49d4-bdbc-65c576a20068 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:31.154257 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd13d7aa-9b83-49d4-bdbc-65c576a20068 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:31.325435 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cd13d7aa-9b83-49d4-bdbc-65c576a20068 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:31.334407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-cd13d7aa-9b83-49d4-bdbc-65c576a20068 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.195777 Sep 09 23:22:31.335590 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 96/171] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:31 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:31.642947 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4b97af4b-97b4-42c8-9629-b39885b9c91c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4eb1935-c1f2-42b9-9f1b-fdee4b6ab4c7", "device": "/dev/sdb"}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:22:31.646035 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4b97af4b-97b4-42c8-9629-b39885b9c91c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:31.652004 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b97af4b-97b4-42c8-9629-b39885b9c91c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:31.652489 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b97af4b-97b4-42c8-9629-b39885b9c91c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:31.652929 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b97af4b-97b4-42c8-9629-b39885b9c91c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:31.653621 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b97af4b-97b4-42c8-9629-b39885b9c91c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:31.654077 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b97af4b-97b4-42c8-9629-b39885b9c91c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:31.654532 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b97af4b-97b4-42c8-9629-b39885b9c91c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:32.358710 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-23881498-349e-4e05-96e3-e46a9063bb33 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:32.360399 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-23881498-349e-4e05-96e3-e46a9063bb33 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:32.368960 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-23881498-349e-4e05-96e3-e46a9063bb33 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:32.369453 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-23881498-349e-4e05-96e3-e46a9063bb33 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:32.369891 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-23881498-349e-4e05-96e3-e46a9063bb33 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:32.370661 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-23881498-349e-4e05-96e3-e46a9063bb33 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:32.371106 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-23881498-349e-4e05-96e3-e46a9063bb33 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:32.371530 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-23881498-349e-4e05-96e3-e46a9063bb33 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:32.560433 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-23881498-349e-4e05-96e3-e46a9063bb33 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:32.569973 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-23881498-349e-4e05-96e3-e46a9063bb33 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1521 microversion: 2.1 time: 0.215414 Sep 09 23:22:32.570589 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 97/172] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:32 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:33.463876 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4b97af4b-97b4-42c8-9629-b39885b9c91c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "POST /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.827070 Sep 09 23:22:33.472827 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 76/173] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 23:22:31 2022] POST /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1/os-volume_attachments => generated 194 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:22:33.472907 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0297560b-3080-4cde-b7e7-e8d4fbc0adbe tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Action: 'create', calling method: .version_select at 0x7f908dfd0550>, body: {"keypair": {"name": "tempest-keypair-3669047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpeV5wFugmmebceCX9A9vFDH8aP23zt4zhM1T4N0jmbaYlRLTRSqJlxXCOODrV8MUTafvbmebdGOhXbF8id16iT1LjgQSGIIKkKCmAAeU//h+ROaR8mKWm7kmjY67VdkA=="}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:22:33.504307 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-0297560b-3080-4cde-b7e7-e8d4fbc0adbe tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Getting quotas for project fbe6c3ad574e46fd9d3b37ead0542a18. Resources: {'key_pairs'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:22:33.506513 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-0297560b-3080-4cde-b7e7-e8d4fbc0adbe tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Getting quotas for user 27be0979440d4ab081dae31790280eff and project fbe6c3ad574e46fd9d3b37ead0542a18. Resources: {'key_pairs'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:22:33.595591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1e7a2d43-c228-44ea-8e67-d4b77e84fa55 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:33.596314 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-1e7a2d43-c228-44ea-8e67-d4b77e84fa55 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:33.603282 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1e7a2d43-c228-44ea-8e67-d4b77e84fa55 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:33.603774 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1e7a2d43-c228-44ea-8e67-d4b77e84fa55 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:33.604261 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1e7a2d43-c228-44ea-8e67-d4b77e84fa55 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:33.606007 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1e7a2d43-c228-44ea-8e67-d4b77e84fa55 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:33.606504 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1e7a2d43-c228-44ea-8e67-d4b77e84fa55 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:33.607197 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1e7a2d43-c228-44ea-8e67-d4b77e84fa55 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:33.624256 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:33.644299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-0297560b-3080-4cde-b7e7-e8d4fbc0adbe tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 398 microversion: 2.20 time: 0.315216 Sep 09 23:22:33.655760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 98/174] 10.222.0.20 () {62 vars in 1200 bytes} [Fri Sep 9 23:22:33 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 323 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 09 23:22:33.818219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1e7a2d43-c228-44ea-8e67-d4b77e84fa55 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:33.818219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-1e7a2d43-c228-44ea-8e67-d4b77e84fa55 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1501 microversion: 2.1 time: 0.209657 Sep 09 23:22:33.818219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 77/175] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:33 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1501 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:22:33.823350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-57537cca-c1b0-4c36-ae1c-4b8b2e0a4ee4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:33.823968 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-57537cca-c1b0-4c36-ae1c-4b8b2e0a4ee4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:33.840588 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-57537cca-c1b0-4c36-ae1c-4b8b2e0a4ee4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:33.840588 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-57537cca-c1b0-4c36-ae1c-4b8b2e0a4ee4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:33.840588 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-57537cca-c1b0-4c36-ae1c-4b8b2e0a4ee4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:33.840588 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-57537cca-c1b0-4c36-ae1c-4b8b2e0a4ee4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:33.840966 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-57537cca-c1b0-4c36-ae1c-4b8b2e0a4ee4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:33.840966 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-57537cca-c1b0-4c36-ae1c-4b8b2e0a4ee4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:34.004882 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-57537cca-c1b0-4c36-ae1c-4b8b2e0a4ee4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:34.013029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-57537cca-c1b0-4c36-ae1c-4b8b2e0a4ee4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1515 microversion: 2.1 time: 0.193453 Sep 09 23:22:34.013610 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 99/176] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:33 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:35.904617 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ffa73659-7c9b-4199-9a42-8cc631db4eb2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:22:35.908188 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ffa73659-7c9b-4199-9a42-8cc631db4eb2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:35.916412 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ffa73659-7c9b-4199-9a42-8cc631db4eb2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:35.917229 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ffa73659-7c9b-4199-9a42-8cc631db4eb2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:35.917671 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ffa73659-7c9b-4199-9a42-8cc631db4eb2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:35.918551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ffa73659-7c9b-4199-9a42-8cc631db4eb2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:35.921404 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ffa73659-7c9b-4199-9a42-8cc631db4eb2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:35.921404 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ffa73659-7c9b-4199-9a42-8cc631db4eb2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:35.945493 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-ffa73659-7c9b-4199-9a42-8cc631db4eb2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lazy-loading 'flavor' on Instance uuid e2b8a715-050b-4cbd-aff9-747f65d1e8b5 {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:22:36.247823 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ffa73659-7c9b-4199-9a42-8cc631db4eb2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "POST /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5/action" status: 200 len: 32 microversion: 2.1 time: 0.346707 Sep 09 23:22:36.250428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 78/177] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 23:22:35 2022] POST /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5/action => generated 32 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:22:36.261558 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0349fb44-8a6e-4cc1-aa4c-400eaf8325b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:36.268920 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-0349fb44-8a6e-4cc1-aa4c-400eaf8325b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:36.276981 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0349fb44-8a6e-4cc1-aa4c-400eaf8325b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:36.277758 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0349fb44-8a6e-4cc1-aa4c-400eaf8325b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:36.278217 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0349fb44-8a6e-4cc1-aa4c-400eaf8325b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:36.278909 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0349fb44-8a6e-4cc1-aa4c-400eaf8325b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:36.279516 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0349fb44-8a6e-4cc1-aa4c-400eaf8325b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:36.280094 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0349fb44-8a6e-4cc1-aa4c-400eaf8325b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:36.472628 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-93829135", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82394614-0ea4-458c-9c02-f5087a7db4e0"}], "security_groups": [{"name": "tempest-securitygroup--457642665"}], "key_name": "tempest-keypair-3669047", "user_data": "}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:22:36.556581 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-0349fb44-8a6e-4cc1-aa4c-400eaf8325b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:36.570817 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-0349fb44-8a6e-4cc1-aa4c-400eaf8325b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.315232 Sep 09 23:22:36.582400 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 100/178] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:36 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:36.620216 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.network.neutron [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] validate_networks() for [('82394614-0ea4-458c-9c02-f5087a7db4e0', None, None, None, None, None)] {{(pid=121058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:22:37.161943 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Flavor limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:22:37.165806 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Image limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:22:37.166490 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Flavor pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:22:37.166926 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Image pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:22:37.167354 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:22:37.194004 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:37.195411 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:37.196380 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:37.200066 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:37.200754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:37.201660 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:37.245330 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Getting quotas for project fbe6c3ad574e46fd9d3b37ead0542a18. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:22:37.249633 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Getting quotas for user 27be0979440d4ab081dae31790280eff and project fbe6c3ad574e46fd9d3b37ead0542a18. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:22:37.263647 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Going to run 1 instances... {{(pid=121058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:22:37.266407 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:22:37.451689 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-750c63f5-ac90-4beb-8287-757346687f80 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.986608 Sep 09 23:22:37.452359 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 79/179] 10.222.0.20 () {62 vars in 1188 bytes} [Fri Sep 9 23:22:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 23:22:37.470278 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-764a05d9-12bb-414c-950b-fd7e06c9c504 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:37.471125 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-764a05d9-12bb-414c-950b-fd7e06c9c504 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:37.534769 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-764a05d9-12bb-414c-950b-fd7e06c9c504 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:37.543944 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-764a05d9-12bb-414c-950b-fd7e06c9c504 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:37.545418 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-764a05d9-12bb-414c-950b-fd7e06c9c504 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:37.547653 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-764a05d9-12bb-414c-950b-fd7e06c9c504 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1277 microversion: 2.20 time: 0.085920 Sep 09 23:22:37.548242 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 101/180] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:37 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:22:37.595867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-49d05cb5-c4e8-4827-8949-9f06d8714f41 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:37.596568 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-49d05cb5-c4e8-4827-8949-9f06d8714f41 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:37.608371 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-49d05cb5-c4e8-4827-8949-9f06d8714f41 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:37.608371 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-49d05cb5-c4e8-4827-8949-9f06d8714f41 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:37.608371 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-49d05cb5-c4e8-4827-8949-9f06d8714f41 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:37.608371 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-49d05cb5-c4e8-4827-8949-9f06d8714f41 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:37.608898 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-49d05cb5-c4e8-4827-8949-9f06d8714f41 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:37.609574 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-49d05cb5-c4e8-4827-8949-9f06d8714f41 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:37.798926 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-49d05cb5-c4e8-4827-8949-9f06d8714f41 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:37.809747 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-49d05cb5-c4e8-4827-8949-9f06d8714f41 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.217963 Sep 09 23:22:37.810329 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 80/181] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:37 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:22:38.574171 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-31a20fc3-016d-4c18-be25-e1f69af6b294 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:38.574764 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-31a20fc3-016d-4c18-be25-e1f69af6b294 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:38.630593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-31a20fc3-016d-4c18-be25-e1f69af6b294 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:38.636441 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-31a20fc3-016d-4c18-be25-e1f69af6b294 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:38.637886 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-31a20fc3-016d-4c18-be25-e1f69af6b294 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:38.639016 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-31a20fc3-016d-4c18-be25-e1f69af6b294 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1277 microversion: 2.20 time: 0.068750 Sep 09 23:22:38.640582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 102/182] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:38 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1277 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:22:38.833055 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1ef6d706-4d43-4683-b911-ef8d1a821e3c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:38.833677 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-1ef6d706-4d43-4683-b911-ef8d1a821e3c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:38.840843 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1ef6d706-4d43-4683-b911-ef8d1a821e3c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:38.841337 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1ef6d706-4d43-4683-b911-ef8d1a821e3c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:38.841965 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1ef6d706-4d43-4683-b911-ef8d1a821e3c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:38.850556 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1ef6d706-4d43-4683-b911-ef8d1a821e3c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:38.850556 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1ef6d706-4d43-4683-b911-ef8d1a821e3c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:38.850556 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1ef6d706-4d43-4683-b911-ef8d1a821e3c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:38.986198 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1ef6d706-4d43-4683-b911-ef8d1a821e3c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:38.994650 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-1ef6d706-4d43-4683-b911-ef8d1a821e3c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.164651 Sep 09 23:22:38.994650 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 81/183] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:38 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:39.666868 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a6c309af-e7cc-4f42-8ced-9fdb937cfba3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:39.667939 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a6c309af-e7cc-4f42-8ced-9fdb937cfba3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:39.676808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a6c309af-e7cc-4f42-8ced-9fdb937cfba3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:39.686684 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a6c309af-e7cc-4f42-8ced-9fdb937cfba3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:39.686684 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a6c309af-e7cc-4f42-8ced-9fdb937cfba3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:39.686684 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a6c309af-e7cc-4f42-8ced-9fdb937cfba3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:39.686684 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a6c309af-e7cc-4f42-8ced-9fdb937cfba3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:39.687548 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a6c309af-e7cc-4f42-8ced-9fdb937cfba3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:39.687548 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=100 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:39.760190 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a6c309af-e7cc-4f42-8ced-9fdb937cfba3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:39.769606 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a6c309af-e7cc-4f42-8ced-9fdb937cfba3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:39.771349 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a6c309af-e7cc-4f42-8ced-9fdb937cfba3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:39.776503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a6c309af-e7cc-4f42-8ced-9fdb937cfba3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1329 microversion: 2.20 time: 0.111756 Sep 09 23:22:39.776503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 103/184] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:39 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1329 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:22:40.017387 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5132d4c3-62bc-4f3e-afea-abf09113f3c5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:40.026386 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5132d4c3-62bc-4f3e-afea-abf09113f3c5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:40.026386 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5132d4c3-62bc-4f3e-afea-abf09113f3c5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:40.026386 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5132d4c3-62bc-4f3e-afea-abf09113f3c5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:40.026386 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5132d4c3-62bc-4f3e-afea-abf09113f3c5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:40.026793 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5132d4c3-62bc-4f3e-afea-abf09113f3c5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:40.026793 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5132d4c3-62bc-4f3e-afea-abf09113f3c5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:40.026793 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5132d4c3-62bc-4f3e-afea-abf09113f3c5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:40.160403 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5132d4c3-62bc-4f3e-afea-abf09113f3c5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:40.168260 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5132d4c3-62bc-4f3e-afea-abf09113f3c5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.154763 Sep 09 23:22:40.168827 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 82/185] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:40 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:40.801012 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3e069699-048d-4b02-a670-37e84361fdbc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:40.801643 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3e069699-048d-4b02-a670-37e84361fdbc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:40.808974 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e069699-048d-4b02-a670-37e84361fdbc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:40.813350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e069699-048d-4b02-a670-37e84361fdbc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:40.813350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e069699-048d-4b02-a670-37e84361fdbc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:40.813350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e069699-048d-4b02-a670-37e84361fdbc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:40.813350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e069699-048d-4b02-a670-37e84361fdbc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:40.813831 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e069699-048d-4b02-a670-37e84361fdbc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:40.920398 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3e069699-048d-4b02-a670-37e84361fdbc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:40.930956 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3e069699-048d-4b02-a670-37e84361fdbc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:40.932870 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3e069699-048d-4b02-a670-37e84361fdbc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:40.934303 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3e069699-048d-4b02-a670-37e84361fdbc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1329 microversion: 2.20 time: 0.138355 Sep 09 23:22:40.935167 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 104/186] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:40 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1329 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:22:41.205131 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7f9574be-fb3e-4624-9c8a-1b1aaf797455 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:41.207308 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7f9574be-fb3e-4624-9c8a-1b1aaf797455 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:41.227525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f9574be-fb3e-4624-9c8a-1b1aaf797455 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:41.228278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f9574be-fb3e-4624-9c8a-1b1aaf797455 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:41.228724 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f9574be-fb3e-4624-9c8a-1b1aaf797455 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:41.230486 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f9574be-fb3e-4624-9c8a-1b1aaf797455 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:41.231098 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f9574be-fb3e-4624-9c8a-1b1aaf797455 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:41.231872 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f9574be-fb3e-4624-9c8a-1b1aaf797455 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:41.414275 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7f9574be-fb3e-4624-9c8a-1b1aaf797455 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:41.423578 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7f9574be-fb3e-4624-9c8a-1b1aaf797455 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.231258 Sep 09 23:22:41.426584 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 83/187] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:41 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:41.961304 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7354c10e-7c2c-4447-8d00-59fe8514ee30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:41.965741 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7354c10e-7c2c-4447-8d00-59fe8514ee30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:41.968658 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7354c10e-7c2c-4447-8d00-59fe8514ee30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:41.969670 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7354c10e-7c2c-4447-8d00-59fe8514ee30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:41.970163 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7354c10e-7c2c-4447-8d00-59fe8514ee30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:41.970927 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7354c10e-7c2c-4447-8d00-59fe8514ee30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:41.971390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7354c10e-7c2c-4447-8d00-59fe8514ee30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:41.971808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7354c10e-7c2c-4447-8d00-59fe8514ee30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:42.177918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7354c10e-7c2c-4447-8d00-59fe8514ee30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:42.187152 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7354c10e-7c2c-4447-8d00-59fe8514ee30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:42.189355 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7354c10e-7c2c-4447-8d00-59fe8514ee30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:42.190902 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7354c10e-7c2c-4447-8d00-59fe8514ee30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.233659 Sep 09 23:22:42.191556 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 105/188] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:41 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:22:42.449601 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ec304994-e93b-4f82-a25a-b5d63c6b8903 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:42.450624 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ec304994-e93b-4f82-a25a-b5d63c6b8903 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:42.457695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec304994-e93b-4f82-a25a-b5d63c6b8903 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:42.458166 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec304994-e93b-4f82-a25a-b5d63c6b8903 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:42.458797 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec304994-e93b-4f82-a25a-b5d63c6b8903 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:42.459483 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec304994-e93b-4f82-a25a-b5d63c6b8903 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:42.459935 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec304994-e93b-4f82-a25a-b5d63c6b8903 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:42.460356 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec304994-e93b-4f82-a25a-b5d63c6b8903 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:42.833683 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ec304994-e93b-4f82-a25a-b5d63c6b8903 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:42.854411 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ec304994-e93b-4f82-a25a-b5d63c6b8903 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.406588 Sep 09 23:22:42.854411 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 84/189] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:42 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:42.987573 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-6a0af457-3003-4769-9ebe-7234a060db59 req-a592473d-6e5a-4501-9af6-02490964f743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a8b2e1-79be-4c0d-b316-94c95ae04638", "tag": "a8c73f48-9a44-48f9-9123-64c486486e8b"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:22:43.001347 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-6a0af457-3003-4769-9ebe-7234a060db59 req-a592473d-6e5a-4501-9af6-02490964f743 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:43.001347 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-6a0af457-3003-4769-9ebe-7234a060db59 req-a592473d-6e5a-4501-9af6-02490964f743 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:43.001347 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-6a0af457-3003-4769-9ebe-7234a060db59 req-a592473d-6e5a-4501-9af6-02490964f743 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:43.011536 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-6a0af457-3003-4769-9ebe-7234a060db59 req-a592473d-6e5a-4501-9af6-02490964f743 service nova] Creating event network-changed:a8c73f48-9a44-48f9-9123-64c486486e8b for instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 on hv-cinder-85032 Sep 09 23:22:43.019290 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-6a0af457-3003-4769-9ebe-7234a060db59 req-a592473d-6e5a-4501-9af6-02490964f743 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036768 Sep 09 23:22:43.020449 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 106/190] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:22:43.219433 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-39cd0891-d350-4d50-b85b-0f43fa884c84 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:43.223054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-39cd0891-d350-4d50-b85b-0f43fa884c84 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:43.226932 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39cd0891-d350-4d50-b85b-0f43fa884c84 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:43.227411 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39cd0891-d350-4d50-b85b-0f43fa884c84 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:43.227870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39cd0891-d350-4d50-b85b-0f43fa884c84 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:43.228562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39cd0891-d350-4d50-b85b-0f43fa884c84 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:43.229008 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39cd0891-d350-4d50-b85b-0f43fa884c84 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:43.229424 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39cd0891-d350-4d50-b85b-0f43fa884c84 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:43.372521 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-39cd0891-d350-4d50-b85b-0f43fa884c84 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:43.381710 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-39cd0891-d350-4d50-b85b-0f43fa884c84 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:43.383227 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-39cd0891-d350-4d50-b85b-0f43fa884c84 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:43.384499 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-39cd0891-d350-4d50-b85b-0f43fa884c84 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.170369 Sep 09 23:22:43.385062 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 85/191] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:43 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:22:43.878832 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b0f78a06-1057-4646-a7c1-22d29348ca1f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:43.879737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b0f78a06-1057-4646-a7c1-22d29348ca1f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:43.886811 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b0f78a06-1057-4646-a7c1-22d29348ca1f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:43.887348 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b0f78a06-1057-4646-a7c1-22d29348ca1f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:43.887743 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b0f78a06-1057-4646-a7c1-22d29348ca1f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:43.888651 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b0f78a06-1057-4646-a7c1-22d29348ca1f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:43.889052 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b0f78a06-1057-4646-a7c1-22d29348ca1f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:43.889503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b0f78a06-1057-4646-a7c1-22d29348ca1f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:44.028699 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b0f78a06-1057-4646-a7c1-22d29348ca1f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:44.036993 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b0f78a06-1057-4646-a7c1-22d29348ca1f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.163734 Sep 09 23:22:44.037544 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 107/192] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:43 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:44.410538 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-876a4d81-83cc-497f-a10e-edf8ab6fc614 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:44.411277 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-876a4d81-83cc-497f-a10e-edf8ab6fc614 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:44.418415 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-876a4d81-83cc-497f-a10e-edf8ab6fc614 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:44.418907 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-876a4d81-83cc-497f-a10e-edf8ab6fc614 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:44.419420 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-876a4d81-83cc-497f-a10e-edf8ab6fc614 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:44.420068 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-876a4d81-83cc-497f-a10e-edf8ab6fc614 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:44.420527 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-876a4d81-83cc-497f-a10e-edf8ab6fc614 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:44.420952 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-876a4d81-83cc-497f-a10e-edf8ab6fc614 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:44.646092 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-876a4d81-83cc-497f-a10e-edf8ab6fc614 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:44.655889 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-876a4d81-83cc-497f-a10e-edf8ab6fc614 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:44.657361 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-876a4d81-83cc-497f-a10e-edf8ab6fc614 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:44.658528 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-876a4d81-83cc-497f-a10e-edf8ab6fc614 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.252811 Sep 09 23:22:44.659146 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 86/193] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:44 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:22:45.066919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-395074db-5866-4530-8a03-5e9a0e088134 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:45.067656 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-395074db-5866-4530-8a03-5e9a0e088134 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:45.075155 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-395074db-5866-4530-8a03-5e9a0e088134 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:45.075435 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-395074db-5866-4530-8a03-5e9a0e088134 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:45.075930 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-395074db-5866-4530-8a03-5e9a0e088134 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:45.077453 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-395074db-5866-4530-8a03-5e9a0e088134 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:45.077453 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-395074db-5866-4530-8a03-5e9a0e088134 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:45.077666 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-395074db-5866-4530-8a03-5e9a0e088134 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:45.221920 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-395074db-5866-4530-8a03-5e9a0e088134 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:45.230768 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-395074db-5866-4530-8a03-5e9a0e088134 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.174031 Sep 09 23:22:45.231598 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 108/194] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:45 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:45.493305 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c75c43b8-b4bc-4c72-a925-5751b1976d82 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:45.498802 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c75c43b8-b4bc-4c72-a925-5751b1976d82 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:45.501488 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c75c43b8-b4bc-4c72-a925-5751b1976d82 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:45.502223 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c75c43b8-b4bc-4c72-a925-5751b1976d82 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:45.502756 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c75c43b8-b4bc-4c72-a925-5751b1976d82 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:45.503467 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c75c43b8-b4bc-4c72-a925-5751b1976d82 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:45.503926 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c75c43b8-b4bc-4c72-a925-5751b1976d82 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:45.504497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c75c43b8-b4bc-4c72-a925-5751b1976d82 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:45.533740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c75c43b8-b4bc-4c72-a925-5751b1976d82 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/ips" status: 200 len: 146 microversion: 2.1 time: 0.044177 Sep 09 23:22:45.534661 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 87/195] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 23:22:45 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:22:45.684148 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-817db5a7-a9de-45f5-909d-a66d598790c6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:45.687057 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-817db5a7-a9de-45f5-909d-a66d598790c6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:45.690939 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-817db5a7-a9de-45f5-909d-a66d598790c6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:45.691422 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-817db5a7-a9de-45f5-909d-a66d598790c6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:45.691850 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-817db5a7-a9de-45f5-909d-a66d598790c6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:45.692549 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-817db5a7-a9de-45f5-909d-a66d598790c6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:45.693009 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-817db5a7-a9de-45f5-909d-a66d598790c6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:45.693485 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-817db5a7-a9de-45f5-909d-a66d598790c6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:45.893221 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-817db5a7-a9de-45f5-909d-a66d598790c6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:45.901476 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-817db5a7-a9de-45f5-909d-a66d598790c6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:45.902857 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-817db5a7-a9de-45f5-909d-a66d598790c6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:45.903956 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-817db5a7-a9de-45f5-909d-a66d598790c6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.223984 Sep 09 23:22:45.904540 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 109/196] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:45 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:22:46.254982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1b3e0b17-f049-4715-a939-e4c201f96cca tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:46.255777 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-1b3e0b17-f049-4715-a939-e4c201f96cca tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:46.261944 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b3e0b17-f049-4715-a939-e4c201f96cca tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:46.262557 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b3e0b17-f049-4715-a939-e4c201f96cca tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:46.263072 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b3e0b17-f049-4715-a939-e4c201f96cca tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:46.263976 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b3e0b17-f049-4715-a939-e4c201f96cca tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:46.264440 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b3e0b17-f049-4715-a939-e4c201f96cca tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:46.264868 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b3e0b17-f049-4715-a939-e4c201f96cca tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:46.425156 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1b3e0b17-f049-4715-a939-e4c201f96cca tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:46.433227 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-1b3e0b17-f049-4715-a939-e4c201f96cca tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.182278 Sep 09 23:22:46.433803 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 88/197] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:46 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:46.929335 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3f55542b-8994-49a1-9553-edce525cae9c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:46.929949 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3f55542b-8994-49a1-9553-edce525cae9c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:46.938442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3f55542b-8994-49a1-9553-edce525cae9c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:46.938442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3f55542b-8994-49a1-9553-edce525cae9c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:46.938442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3f55542b-8994-49a1-9553-edce525cae9c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:46.938442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3f55542b-8994-49a1-9553-edce525cae9c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:46.938854 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3f55542b-8994-49a1-9553-edce525cae9c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:46.939285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3f55542b-8994-49a1-9553-edce525cae9c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:47.068972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3f55542b-8994-49a1-9553-edce525cae9c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:47.082159 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3f55542b-8994-49a1-9553-edce525cae9c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:47.082159 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3f55542b-8994-49a1-9553-edce525cae9c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:47.082159 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3f55542b-8994-49a1-9553-edce525cae9c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.155773 Sep 09 23:22:47.082473 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 110/198] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:46 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:22:47.174436 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1358790393", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "networks": [{"uuid": "12da80aa-e764-40ac-93e6-d72eb4e5ad16"}]}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:22:47.227147 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.network.neutron [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] validate_networks() for [('12da80aa-e764-40ac-93e6-d72eb4e5ad16', None, None, None, None, None)] {{(pid=121058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:22:47.231573 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=2 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:47.259612 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=6 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:47.460212 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8b5e1c73-3771-47d7-add3-21f78f27c95d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:47.461369 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8b5e1c73-3771-47d7-add3-21f78f27c95d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:47.467638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b5e1c73-3771-47d7-add3-21f78f27c95d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:47.468203 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b5e1c73-3771-47d7-add3-21f78f27c95d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:47.468956 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b5e1c73-3771-47d7-add3-21f78f27c95d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:47.469888 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b5e1c73-3771-47d7-add3-21f78f27c95d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:47.470397 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b5e1c73-3771-47d7-add3-21f78f27c95d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:47.470800 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b5e1c73-3771-47d7-add3-21f78f27c95d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:47.604960 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8b5e1c73-3771-47d7-add3-21f78f27c95d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:47.605643 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Flavor limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:22:47.606784 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Image limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:22:47.606784 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Flavor pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:22:47.607082 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Image pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:22:47.607585 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:22:47.613982 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8b5e1c73-3771-47d7-add3-21f78f27c95d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.157721 Sep 09 23:22:47.614652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 111/199] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:47 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:22:47.616489 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:47.616971 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:47.617400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:47.618153 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:47.618638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:47.619112 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:47.636817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Getting quotas for project 44a4181be7e6404487bd7eddca1f6d8c. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:22:47.641187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Getting quotas for user 75c27b297062483598cf8ff5185e2f2a and project 44a4181be7e6404487bd7eddca1f6d8c. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:22:47.652005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Going to run 1 instances... {{(pid=121058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:22:47.654208 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:22:48.026748 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-27781454-a079-447d-95b6-756dafc57057 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856064 Sep 09 23:22:48.027365 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 89/200] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:22:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:22:48.039303 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a2103887-e955-4c80-89f8-2ea19d212a11 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:48.039913 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a2103887-e955-4c80-89f8-2ea19d212a11 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:48.094926 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a2103887-e955-4c80-89f8-2ea19d212a11 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:48.102311 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a2103887-e955-4c80-89f8-2ea19d212a11 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1214 microversion: 2.1 time: 0.066851 Sep 09 23:22:48.102912 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 112/201] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:48 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:48.114541 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-51218f85-01c6-4b20-96bc-ade794c14003 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:48.114541 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-51218f85-01c6-4b20-96bc-ade794c14003 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:48.115660 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-51218f85-01c6-4b20-96bc-ade794c14003 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:48.120877 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-51218f85-01c6-4b20-96bc-ade794c14003 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:48.121359 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-51218f85-01c6-4b20-96bc-ade794c14003 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:48.122147 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-51218f85-01c6-4b20-96bc-ade794c14003 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:48.122705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-51218f85-01c6-4b20-96bc-ade794c14003 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:48.123132 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-51218f85-01c6-4b20-96bc-ade794c14003 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:48.275056 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-51218f85-01c6-4b20-96bc-ade794c14003 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:48.284268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-51218f85-01c6-4b20-96bc-ade794c14003 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:48.285665 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-51218f85-01c6-4b20-96bc-ade794c14003 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:48.286814 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-51218f85-01c6-4b20-96bc-ade794c14003 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.183559 Sep 09 23:22:48.287372 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 90/202] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:48 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:22:48.643060 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e5bebd64-38b7-4b46-9dc1-d30a9ad8b662 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:48.643678 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e5bebd64-38b7-4b46-9dc1-d30a9ad8b662 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:48.649762 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e5bebd64-38b7-4b46-9dc1-d30a9ad8b662 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:48.650258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e5bebd64-38b7-4b46-9dc1-d30a9ad8b662 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:48.650714 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e5bebd64-38b7-4b46-9dc1-d30a9ad8b662 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:48.651409 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e5bebd64-38b7-4b46-9dc1-d30a9ad8b662 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:48.651864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e5bebd64-38b7-4b46-9dc1-d30a9ad8b662 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:48.652287 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e5bebd64-38b7-4b46-9dc1-d30a9ad8b662 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:48.788612 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e5bebd64-38b7-4b46-9dc1-d30a9ad8b662 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:48.796265 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e5bebd64-38b7-4b46-9dc1-d30a9ad8b662 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.159981 Sep 09 23:22:48.797337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 113/203] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:48 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:49.126205 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-37a1aaf7-4114-47a0-88da-8abbcfcddabb tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:49.130423 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-37a1aaf7-4114-47a0-88da-8abbcfcddabb tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:49.180878 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-37a1aaf7-4114-47a0-88da-8abbcfcddabb tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:49.189383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-37a1aaf7-4114-47a0-88da-8abbcfcddabb tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1214 microversion: 2.1 time: 0.067181 Sep 09 23:22:49.190169 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 91/204] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:49 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:49.313363 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1da45792-fce9-457b-87e7-794fbe22204a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:49.314017 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1da45792-fce9-457b-87e7-794fbe22204a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:49.320653 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1da45792-fce9-457b-87e7-794fbe22204a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:49.321133 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1da45792-fce9-457b-87e7-794fbe22204a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:49.321566 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1da45792-fce9-457b-87e7-794fbe22204a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:49.322248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1da45792-fce9-457b-87e7-794fbe22204a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:49.322726 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1da45792-fce9-457b-87e7-794fbe22204a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:49.323151 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1da45792-fce9-457b-87e7-794fbe22204a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:49.460626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1da45792-fce9-457b-87e7-794fbe22204a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:49.468822 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1da45792-fce9-457b-87e7-794fbe22204a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:49.470276 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1da45792-fce9-457b-87e7-794fbe22204a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:49.471501 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1da45792-fce9-457b-87e7-794fbe22204a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.162642 Sep 09 23:22:49.472066 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 114/205] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:49 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:22:49.821790 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5ea62fa7-8656-48b0-958e-b881dfce4d1e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:49.822441 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5ea62fa7-8656-48b0-958e-b881dfce4d1e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:49.824708 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:49.831136 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5ea62fa7-8656-48b0-958e-b881dfce4d1e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:49.833149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5ea62fa7-8656-48b0-958e-b881dfce4d1e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:49.833149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5ea62fa7-8656-48b0-958e-b881dfce4d1e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:49.833149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5ea62fa7-8656-48b0-958e-b881dfce4d1e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:49.833149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5ea62fa7-8656-48b0-958e-b881dfce4d1e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:49.833565 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5ea62fa7-8656-48b0-958e-b881dfce4d1e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:49.967617 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5ea62fa7-8656-48b0-958e-b881dfce4d1e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:49.976095 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5ea62fa7-8656-48b0-958e-b881dfce4d1e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.158249 Sep 09 23:22:49.976667 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 92/206] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:49 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:50.213020 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-34aff79c-1242-4cd0-b5d6-5cff890b744f tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:50.213643 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-34aff79c-1242-4cd0-b5d6-5cff890b744f tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:50.220445 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-34aff79c-1242-4cd0-b5d6-5cff890b744f tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:50.229650 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-34aff79c-1242-4cd0-b5d6-5cff890b744f tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:50.229650 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-34aff79c-1242-4cd0-b5d6-5cff890b744f tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:50.229650 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-34aff79c-1242-4cd0-b5d6-5cff890b744f tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:50.229650 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-34aff79c-1242-4cd0-b5d6-5cff890b744f tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:50.230006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-34aff79c-1242-4cd0-b5d6-5cff890b744f tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:50.283173 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-34aff79c-1242-4cd0-b5d6-5cff890b744f tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:50.291312 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-34aff79c-1242-4cd0-b5d6-5cff890b744f tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1218 microversion: 2.1 time: 0.082209 Sep 09 23:22:50.299441 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 115/207] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:50 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:50.499214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3612d085-81ca-42c3-9a2c-67443fb8feef tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:50.500766 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3612d085-81ca-42c3-9a2c-67443fb8feef tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:50.507830 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3612d085-81ca-42c3-9a2c-67443fb8feef tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:50.508315 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3612d085-81ca-42c3-9a2c-67443fb8feef tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:50.509423 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3612d085-81ca-42c3-9a2c-67443fb8feef tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:50.510219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3612d085-81ca-42c3-9a2c-67443fb8feef tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:50.510847 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3612d085-81ca-42c3-9a2c-67443fb8feef tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:50.511272 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3612d085-81ca-42c3-9a2c-67443fb8feef tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:50.682808 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3612d085-81ca-42c3-9a2c-67443fb8feef tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:50.692072 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3612d085-81ca-42c3-9a2c-67443fb8feef tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:50.693504 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3612d085-81ca-42c3-9a2c-67443fb8feef tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:50.694670 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3612d085-81ca-42c3-9a2c-67443fb8feef tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.201525 Sep 09 23:22:50.695236 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 93/208] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:50 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:22:50.999455 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1107641a-6341-4556-9b64-5af5f0ab8bde tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:51.000250 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1107641a-6341-4556-9b64-5af5f0ab8bde tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:51.012030 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1107641a-6341-4556-9b64-5af5f0ab8bde tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:51.012531 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1107641a-6341-4556-9b64-5af5f0ab8bde tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:51.012974 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1107641a-6341-4556-9b64-5af5f0ab8bde tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:51.013680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1107641a-6341-4556-9b64-5af5f0ab8bde tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:51.014328 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1107641a-6341-4556-9b64-5af5f0ab8bde tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:51.014778 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1107641a-6341-4556-9b64-5af5f0ab8bde tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:51.164335 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1107641a-6341-4556-9b64-5af5f0ab8bde tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:51.173330 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1107641a-6341-4556-9b64-5af5f0ab8bde tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.177735 Sep 09 23:22:51.173911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 116/209] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:50 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:51.314463 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0eab8bb9-be01-4f9a-a313-0a954c6aff53 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:51.316020 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0eab8bb9-be01-4f9a-a313-0a954c6aff53 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:51.321209 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0eab8bb9-be01-4f9a-a313-0a954c6aff53 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:51.321749 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0eab8bb9-be01-4f9a-a313-0a954c6aff53 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:51.322133 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0eab8bb9-be01-4f9a-a313-0a954c6aff53 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:51.322856 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0eab8bb9-be01-4f9a-a313-0a954c6aff53 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:51.323314 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0eab8bb9-be01-4f9a-a313-0a954c6aff53 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:51.323738 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0eab8bb9-be01-4f9a-a313-0a954c6aff53 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:51.391596 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0eab8bb9-be01-4f9a-a313-0a954c6aff53 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:51.394501 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:51.401493 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0eab8bb9-be01-4f9a-a313-0a954c6aff53 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1266 microversion: 2.1 time: 0.091264 Sep 09 23:22:51.402070 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 94/210] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:51 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:51.723807 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-79d17abd-0c0b-4323-89ba-8f89e8d5e281 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:51.724408 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-79d17abd-0c0b-4323-89ba-8f89e8d5e281 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:51.730595 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-79d17abd-0c0b-4323-89ba-8f89e8d5e281 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:51.731080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-79d17abd-0c0b-4323-89ba-8f89e8d5e281 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:51.731517 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-79d17abd-0c0b-4323-89ba-8f89e8d5e281 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:51.732209 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-79d17abd-0c0b-4323-89ba-8f89e8d5e281 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:51.732667 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-79d17abd-0c0b-4323-89ba-8f89e8d5e281 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:51.733088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-79d17abd-0c0b-4323-89ba-8f89e8d5e281 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:51.863228 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-79d17abd-0c0b-4323-89ba-8f89e8d5e281 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:51.871127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-79d17abd-0c0b-4323-89ba-8f89e8d5e281 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:51.872567 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-79d17abd-0c0b-4323-89ba-8f89e8d5e281 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:51.873659 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-79d17abd-0c0b-4323-89ba-8f89e8d5e281 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.153839 Sep 09 23:22:51.874211 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 117/211] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:51 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:22:52.197647 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-2c53c7fd-d1c4-40c0-aa7c-7d7871efb3e2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:52.198265 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-2c53c7fd-d1c4-40c0-aa7c-7d7871efb3e2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:52.205199 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2c53c7fd-d1c4-40c0-aa7c-7d7871efb3e2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:52.205682 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2c53c7fd-d1c4-40c0-aa7c-7d7871efb3e2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:52.206124 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2c53c7fd-d1c4-40c0-aa7c-7d7871efb3e2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:52.206843 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2c53c7fd-d1c4-40c0-aa7c-7d7871efb3e2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:52.207304 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2c53c7fd-d1c4-40c0-aa7c-7d7871efb3e2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:52.207734 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2c53c7fd-d1c4-40c0-aa7c-7d7871efb3e2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:52.337551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-2c53c7fd-d1c4-40c0-aa7c-7d7871efb3e2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:52.345539 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-2c53c7fd-d1c4-40c0-aa7c-7d7871efb3e2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.152224 Sep 09 23:22:52.352348 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 95/212] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:52 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:52.431501 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ef6c4988-ec34-4c43-a4ad-a05a54c55194 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:52.432191 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ef6c4988-ec34-4c43-a4ad-a05a54c55194 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:52.439229 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef6c4988-ec34-4c43-a4ad-a05a54c55194 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:52.443496 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef6c4988-ec34-4c43-a4ad-a05a54c55194 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:52.443496 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef6c4988-ec34-4c43-a4ad-a05a54c55194 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:52.443496 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef6c4988-ec34-4c43-a4ad-a05a54c55194 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:52.443496 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef6c4988-ec34-4c43-a4ad-a05a54c55194 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:52.444025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef6c4988-ec34-4c43-a4ad-a05a54c55194 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:52.502908 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ef6c4988-ec34-4c43-a4ad-a05a54c55194 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:52.510575 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ef6c4988-ec34-4c43-a4ad-a05a54c55194 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1266 microversion: 2.1 time: 0.083512 Sep 09 23:22:52.511161 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 118/213] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:52 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:52.900965 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0cb0e007-edcc-42b4-9c88-44c0254183a8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:52.901570 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0cb0e007-edcc-42b4-9c88-44c0254183a8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:52.911261 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0cb0e007-edcc-42b4-9c88-44c0254183a8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:52.911733 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0cb0e007-edcc-42b4-9c88-44c0254183a8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:52.912254 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0cb0e007-edcc-42b4-9c88-44c0254183a8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:52.912965 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0cb0e007-edcc-42b4-9c88-44c0254183a8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:52.913421 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0cb0e007-edcc-42b4-9c88-44c0254183a8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:52.913843 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0cb0e007-edcc-42b4-9c88-44c0254183a8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:53.190720 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0cb0e007-edcc-42b4-9c88-44c0254183a8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:53.198676 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0cb0e007-edcc-42b4-9c88-44c0254183a8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:53.200110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0cb0e007-edcc-42b4-9c88-44c0254183a8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:53.201192 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0cb0e007-edcc-42b4-9c88-44c0254183a8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.304822 Sep 09 23:22:53.201749 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 96/214] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:52 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:22:53.369119 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8f8c7c82-fc4d-4065-bed3-01c2a38f6edb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:53.369853 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8f8c7c82-fc4d-4065-bed3-01c2a38f6edb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:53.380442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f8c7c82-fc4d-4065-bed3-01c2a38f6edb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:53.380442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f8c7c82-fc4d-4065-bed3-01c2a38f6edb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:53.380442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f8c7c82-fc4d-4065-bed3-01c2a38f6edb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:53.380442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f8c7c82-fc4d-4065-bed3-01c2a38f6edb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:53.380784 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f8c7c82-fc4d-4065-bed3-01c2a38f6edb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:53.380784 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f8c7c82-fc4d-4065-bed3-01c2a38f6edb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:53.528134 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8f8c7c82-fc4d-4065-bed3-01c2a38f6edb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:53.533165 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1ecef81c-292b-41f7-aa0e-0c154a745346 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:53.533794 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-1ecef81c-292b-41f7-aa0e-0c154a745346 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:53.535940 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8f8c7c82-fc4d-4065-bed3-01c2a38f6edb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.170747 Sep 09 23:22:53.538723 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 119/215] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:53 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:53.540808 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1ecef81c-292b-41f7-aa0e-0c154a745346 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:53.541297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1ecef81c-292b-41f7-aa0e-0c154a745346 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:53.541738 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1ecef81c-292b-41f7-aa0e-0c154a745346 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:53.542461 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1ecef81c-292b-41f7-aa0e-0c154a745346 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:53.542920 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1ecef81c-292b-41f7-aa0e-0c154a745346 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:53.543350 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1ecef81c-292b-41f7-aa0e-0c154a745346 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:53.604586 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1ecef81c-292b-41f7-aa0e-0c154a745346 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:53.612943 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-1ecef81c-292b-41f7-aa0e-0c154a745346 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1266 microversion: 2.1 time: 0.083852 Sep 09 23:22:53.613516 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 97/216] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:53 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:22:54.227138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f86873ce-a093-475c-9835-b1e4673b948c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:54.227742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f86873ce-a093-475c-9835-b1e4673b948c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:54.233869 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f86873ce-a093-475c-9835-b1e4673b948c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:54.235119 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f86873ce-a093-475c-9835-b1e4673b948c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:54.235583 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f86873ce-a093-475c-9835-b1e4673b948c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:54.236267 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f86873ce-a093-475c-9835-b1e4673b948c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:54.236717 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f86873ce-a093-475c-9835-b1e4673b948c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:54.237137 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f86873ce-a093-475c-9835-b1e4673b948c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:54.372869 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f86873ce-a093-475c-9835-b1e4673b948c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:54.381907 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f86873ce-a093-475c-9835-b1e4673b948c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:54.383411 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f86873ce-a093-475c-9835-b1e4673b948c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:54.384538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f86873ce-a093-475c-9835-b1e4673b948c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.161316 Sep 09 23:22:54.385105 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 120/217] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:54 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:22:54.558852 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a76e6cdd-5f3a-4268-b477-05c3987f77a9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:54.559466 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a76e6cdd-5f3a-4268-b477-05c3987f77a9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:54.566876 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a76e6cdd-5f3a-4268-b477-05c3987f77a9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:54.567365 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a76e6cdd-5f3a-4268-b477-05c3987f77a9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:54.567802 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a76e6cdd-5f3a-4268-b477-05c3987f77a9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:54.568773 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a76e6cdd-5f3a-4268-b477-05c3987f77a9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:54.569225 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a76e6cdd-5f3a-4268-b477-05c3987f77a9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:54.569650 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a76e6cdd-5f3a-4268-b477-05c3987f77a9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:54.640337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-be9f9b49-b0fb-4b9f-bcbd-5fba898feaa7 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:54.642110 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-be9f9b49-b0fb-4b9f-bcbd-5fba898feaa7 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:54.651150 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-be9f9b49-b0fb-4b9f-bcbd-5fba898feaa7 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:54.654329 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-be9f9b49-b0fb-4b9f-bcbd-5fba898feaa7 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:54.654710 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-be9f9b49-b0fb-4b9f-bcbd-5fba898feaa7 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:54.655451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-be9f9b49-b0fb-4b9f-bcbd-5fba898feaa7 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:54.656015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-be9f9b49-b0fb-4b9f-bcbd-5fba898feaa7 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:54.660156 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-be9f9b49-b0fb-4b9f-bcbd-5fba898feaa7 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:54.713812 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=100 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:54.752078 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a76e6cdd-5f3a-4268-b477-05c3987f77a9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:54.760820 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a76e6cdd-5f3a-4268-b477-05c3987f77a9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.205722 Sep 09 23:22:54.761706 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 98/218] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:54 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:54.790089 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-be9f9b49-b0fb-4b9f-bcbd-5fba898feaa7 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:54.799492 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-be9f9b49-b0fb-4b9f-bcbd-5fba898feaa7 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1266 microversion: 2.1 time: 0.166813 Sep 09 23:22:54.800316 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 121/219] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:54 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:22:55.411163 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-589c1c16-0599-48b8-872a-c89e45e27ce3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:55.412641 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-589c1c16-0599-48b8-872a-c89e45e27ce3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:55.423700 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-589c1c16-0599-48b8-872a-c89e45e27ce3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:55.424995 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-589c1c16-0599-48b8-872a-c89e45e27ce3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:55.424995 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-589c1c16-0599-48b8-872a-c89e45e27ce3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:55.425376 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-589c1c16-0599-48b8-872a-c89e45e27ce3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:55.426080 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-589c1c16-0599-48b8-872a-c89e45e27ce3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:55.426723 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-589c1c16-0599-48b8-872a-c89e45e27ce3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:55.569297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-589c1c16-0599-48b8-872a-c89e45e27ce3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:55.577632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-589c1c16-0599-48b8-872a-c89e45e27ce3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:55.579596 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-589c1c16-0599-48b8-872a-c89e45e27ce3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:55.580844 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-589c1c16-0599-48b8-872a-c89e45e27ce3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.174329 Sep 09 23:22:55.581578 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 99/220] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:55 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:22:55.605032 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3e4749a6-5fea-4f08-bc5e-4ee06cc135dc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec811f49-2113-4dc1-8d33-1c36ee511f2a"}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:22:55.607850 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3e4749a6-5fea-4f08-bc5e-4ee06cc135dc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:55.614963 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e4749a6-5fea-4f08-bc5e-4ee06cc135dc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:55.615457 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e4749a6-5fea-4f08-bc5e-4ee06cc135dc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:55.615892 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e4749a6-5fea-4f08-bc5e-4ee06cc135dc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:55.616603 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e4749a6-5fea-4f08-bc5e-4ee06cc135dc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:55.617054 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e4749a6-5fea-4f08-bc5e-4ee06cc135dc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:55.617478 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e4749a6-5fea-4f08-bc5e-4ee06cc135dc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:55.791010 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-87b8bc1c-599d-457b-893b-acb16cd8532b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:55.791484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-87b8bc1c-599d-457b-893b-acb16cd8532b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:55.797552 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-87b8bc1c-599d-457b-893b-acb16cd8532b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:55.798056 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-87b8bc1c-599d-457b-893b-acb16cd8532b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:55.798520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-87b8bc1c-599d-457b-893b-acb16cd8532b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:55.799208 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-87b8bc1c-599d-457b-893b-acb16cd8532b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:55.799695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-87b8bc1c-599d-457b-893b-acb16cd8532b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:55.800120 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-87b8bc1c-599d-457b-893b-acb16cd8532b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:55.929359 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-87b8bc1c-599d-457b-893b-acb16cd8532b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:55.938006 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-87b8bc1c-599d-457b-893b-acb16cd8532b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.150513 Sep 09 23:22:55.938335 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 100/221] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:55 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:22:55.943074 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-d994650f-a1ab-44d4-ae3a-53081b7c6c22 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:55.943685 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-d994650f-a1ab-44d4-ae3a-53081b7c6c22 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:55.949494 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d994650f-a1ab-44d4-ae3a-53081b7c6c22 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:55.949970 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d994650f-a1ab-44d4-ae3a-53081b7c6c22 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:55.950422 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d994650f-a1ab-44d4-ae3a-53081b7c6c22 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:55.951188 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d994650f-a1ab-44d4-ae3a-53081b7c6c22 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:55.951640 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d994650f-a1ab-44d4-ae3a-53081b7c6c22 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:55.954459 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d994650f-a1ab-44d4-ae3a-53081b7c6c22 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:56.088916 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d994650f-a1ab-44d4-ae3a-53081b7c6c22 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:56.096539 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-d994650f-a1ab-44d4-ae3a-53081b7c6c22 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1314 microversion: 2.1 time: 0.157234 Sep 09 23:22:56.097109 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 101/222] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:55 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:56.606044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1bb40876-33f5-4f07-8faa-e1dcf1833a66 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:56.606662 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-1bb40876-33f5-4f07-8faa-e1dcf1833a66 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:56.612956 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1bb40876-33f5-4f07-8faa-e1dcf1833a66 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:56.614684 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1bb40876-33f5-4f07-8faa-e1dcf1833a66 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:56.614684 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1bb40876-33f5-4f07-8faa-e1dcf1833a66 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:56.614684 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1bb40876-33f5-4f07-8faa-e1dcf1833a66 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:56.615052 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1bb40876-33f5-4f07-8faa-e1dcf1833a66 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:56.615475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1bb40876-33f5-4f07-8faa-e1dcf1833a66 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:56.754626 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1bb40876-33f5-4f07-8faa-e1dcf1833a66 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:56.763230 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1bb40876-33f5-4f07-8faa-e1dcf1833a66 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:56.765028 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1bb40876-33f5-4f07-8faa-e1dcf1833a66 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:56.767081 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-1bb40876-33f5-4f07-8faa-e1dcf1833a66 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.165258 Sep 09 23:22:56.767858 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 102/223] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:56 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:22:56.962738 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-dad09bd0-126b-4394-a531-6c828af031f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:56.963090 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-dad09bd0-126b-4394-a531-6c828af031f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:56.971765 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dad09bd0-126b-4394-a531-6c828af031f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:56.974317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dad09bd0-126b-4394-a531-6c828af031f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:56.974317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dad09bd0-126b-4394-a531-6c828af031f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:56.974317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dad09bd0-126b-4394-a531-6c828af031f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:56.974317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dad09bd0-126b-4394-a531-6c828af031f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:56.975298 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dad09bd0-126b-4394-a531-6c828af031f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:57.139358 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-dad09bd0-126b-4394-a531-6c828af031f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:57.147606 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-dad09bd0-126b-4394-a531-6c828af031f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.190066 Sep 09 23:22:57.148415 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 103/224] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:56 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:57.153092 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4c9b1c87-4a8e-4751-a16c-074e26ef3bd4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:57.153636 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4c9b1c87-4a8e-4751-a16c-074e26ef3bd4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:57.167014 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c9b1c87-4a8e-4751-a16c-074e26ef3bd4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:57.170559 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c9b1c87-4a8e-4751-a16c-074e26ef3bd4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:57.170559 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c9b1c87-4a8e-4751-a16c-074e26ef3bd4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:57.170559 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c9b1c87-4a8e-4751-a16c-074e26ef3bd4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:57.170559 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c9b1c87-4a8e-4751-a16c-074e26ef3bd4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:57.171010 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c9b1c87-4a8e-4751-a16c-074e26ef3bd4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:57.304797 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4c9b1c87-4a8e-4751-a16c-074e26ef3bd4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:57.312781 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4c9b1c87-4a8e-4751-a16c-074e26ef3bd4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1314 microversion: 2.1 time: 0.163498 Sep 09 23:22:57.313601 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 104/225] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:57 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:57.332665 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-a93a0cdf-60ea-448e-bb88-3bc2f92e7649 req-fa5bb015-9263-4786-ba6d-d749ef01e8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a8b2e1-79be-4c0d-b316-94c95ae04638", "name": "network-vif-plugged", "status": "completed", "tag": "a8c73f48-9a44-48f9-9123-64c486486e8b"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:22:57.345756 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-a93a0cdf-60ea-448e-bb88-3bc2f92e7649 req-fa5bb015-9263-4786-ba6d-d749ef01e8d7 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:57.345756 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-a93a0cdf-60ea-448e-bb88-3bc2f92e7649 req-fa5bb015-9263-4786-ba6d-d749ef01e8d7 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:57.345756 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-a93a0cdf-60ea-448e-bb88-3bc2f92e7649 req-fa5bb015-9263-4786-ba6d-d749ef01e8d7 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:57.360359 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-a93a0cdf-60ea-448e-bb88-3bc2f92e7649 req-fa5bb015-9263-4786-ba6d-d749ef01e8d7 service nova] Creating event network-vif-plugged:a8c73f48-9a44-48f9-9123-64c486486e8b for instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 on hv-cinder-85032 Sep 09 23:22:57.365683 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-a93a0cdf-60ea-448e-bb88-3bc2f92e7649 req-fa5bb015-9263-4786-ba6d-d749ef01e8d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037917 Sep 09 23:22:57.366618 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 105/226] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:22:57.561658 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3e4749a6-5fea-4f08-bc5e-4ee06cc135dc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "POST /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.959250 Sep 09 23:22:57.562713 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 122/227] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 23:22:55 2022] POST /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/os-volume_attachments => generated 194 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:22:57.707597 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-c8ef9804-78db-4cd3-972e-71c46e240813 req-950ce883-e903-4e05-97ae-fd0359f97e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "429d85b0-48f0-43c4-91df-43c474018d06", "tag": "e39db3e3-406c-4eda-ab71-1d721a17ed2b"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:22:57.714216 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=2 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:57.724275 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c8ef9804-78db-4cd3-972e-71c46e240813 req-950ce883-e903-4e05-97ae-fd0359f97e78 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:57.724956 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c8ef9804-78db-4cd3-972e-71c46e240813 req-950ce883-e903-4e05-97ae-fd0359f97e78 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:57.725926 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c8ef9804-78db-4cd3-972e-71c46e240813 req-950ce883-e903-4e05-97ae-fd0359f97e78 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:57.748389 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-c8ef9804-78db-4cd3-972e-71c46e240813 req-950ce883-e903-4e05-97ae-fd0359f97e78 service nova] Creating event network-changed:e39db3e3-406c-4eda-ab71-1d721a17ed2b for instance 429d85b0-48f0-43c4-91df-43c474018d06 on hv-cinder-85032 Sep 09 23:22:57.753742 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-c8ef9804-78db-4cd3-972e-71c46e240813 req-950ce883-e903-4e05-97ae-fd0359f97e78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054017 Sep 09 23:22:57.754624 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 106/228] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:22:57.795814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e84e7da8-d63d-434a-bdcf-d387825ff2e9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:57.796558 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e84e7da8-d63d-434a-bdcf-d387825ff2e9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:57.798575 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:57.803575 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e84e7da8-d63d-434a-bdcf-d387825ff2e9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:57.804063 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e84e7da8-d63d-434a-bdcf-d387825ff2e9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:57.807064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e84e7da8-d63d-434a-bdcf-d387825ff2e9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:57.807064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e84e7da8-d63d-434a-bdcf-d387825ff2e9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:57.807064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e84e7da8-d63d-434a-bdcf-d387825ff2e9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:57.807064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e84e7da8-d63d-434a-bdcf-d387825ff2e9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:57.971745 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e84e7da8-d63d-434a-bdcf-d387825ff2e9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:57.981496 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e84e7da8-d63d-434a-bdcf-d387825ff2e9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:57.983224 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e84e7da8-d63d-434a-bdcf-d387825ff2e9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:57.984557 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e84e7da8-d63d-434a-bdcf-d387825ff2e9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.193196 Sep 09 23:22:57.985361 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 123/229] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:57 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:22:58.174859 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9b72ebf3-acca-44c5-8d44-a8c8af2262df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:58.175562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9b72ebf3-acca-44c5-8d44-a8c8af2262df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:58.182221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9b72ebf3-acca-44c5-8d44-a8c8af2262df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:58.182779 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9b72ebf3-acca-44c5-8d44-a8c8af2262df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:58.183278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9b72ebf3-acca-44c5-8d44-a8c8af2262df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:58.183979 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9b72ebf3-acca-44c5-8d44-a8c8af2262df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:58.184492 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9b72ebf3-acca-44c5-8d44-a8c8af2262df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:58.184923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9b72ebf3-acca-44c5-8d44-a8c8af2262df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:58.318914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9b72ebf3-acca-44c5-8d44-a8c8af2262df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:58.326683 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9b72ebf3-acca-44c5-8d44-a8c8af2262df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.156211 Sep 09 23:22:58.327248 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 107/230] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:58 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:58.339416 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ab5252db-7230-4048-b7d4-a84a661656ee tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:58.340255 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ab5252db-7230-4048-b7d4-a84a661656ee tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:58.342514 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=10 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:58.347378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab5252db-7230-4048-b7d4-a84a661656ee tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:58.351010 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab5252db-7230-4048-b7d4-a84a661656ee tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:58.351010 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab5252db-7230-4048-b7d4-a84a661656ee tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:58.351010 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab5252db-7230-4048-b7d4-a84a661656ee tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:58.351010 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab5252db-7230-4048-b7d4-a84a661656ee tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:58.351452 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab5252db-7230-4048-b7d4-a84a661656ee tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:58.480790 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ab5252db-7230-4048-b7d4-a84a661656ee tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:58.489268 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ab5252db-7230-4048-b7d4-a84a661656ee tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1314 microversion: 2.1 time: 0.153787 Sep 09 23:22:58.489831 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 124/231] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:58 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:22:58.780459 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-d86d1b2a-a71a-4223-a075-d6a084b47680 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:58.780977 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-d86d1b2a-a71a-4223-a075-d6a084b47680 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:58.787997 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d86d1b2a-a71a-4223-a075-d6a084b47680 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:58.788483 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d86d1b2a-a71a-4223-a075-d6a084b47680 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:58.788923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d86d1b2a-a71a-4223-a075-d6a084b47680 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:58.789644 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d86d1b2a-a71a-4223-a075-d6a084b47680 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:58.790091 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d86d1b2a-a71a-4223-a075-d6a084b47680 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:58.790556 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d86d1b2a-a71a-4223-a075-d6a084b47680 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:58.920378 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-d86d1b2a-a71a-4223-a075-d6a084b47680 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lazy-loading 'services' on Instance uuid 0083662b-22d2-4477-af67-902c53f634a1 {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:22:59.011132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-40f9f463-6a53-4150-8abe-6c561fdb84ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:59.011873 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-40f9f463-6a53-4150-8abe-6c561fdb84ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:59.019343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-40f9f463-6a53-4150-8abe-6c561fdb84ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:59.019824 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-40f9f463-6a53-4150-8abe-6c561fdb84ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:59.020253 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-40f9f463-6a53-4150-8abe-6c561fdb84ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:59.020979 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-40f9f463-6a53-4150-8abe-6c561fdb84ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:59.021495 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-40f9f463-6a53-4150-8abe-6c561fdb84ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:59.021910 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-40f9f463-6a53-4150-8abe-6c561fdb84ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:59.185670 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=8 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:22:59.193811 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-40f9f463-6a53-4150-8abe-6c561fdb84ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:59.201785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-40f9f463-6a53-4150-8abe-6c561fdb84ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:59.203251 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-40f9f463-6a53-4150-8abe-6c561fdb84ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:59.204388 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-40f9f463-6a53-4150-8abe-6c561fdb84ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.197177 Sep 09 23:22:59.204949 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 125/232] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:22:59 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:22:59.292127 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-d86d1b2a-a71a-4223-a075-d6a084b47680 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1/os-volume_attachments/d4eb1935-c1f2-42b9-9f1b-fdee4b6ab4c7" status: 202 len: 0 microversion: 2.1 time: 0.515461 Sep 09 23:22:59.292724 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 108/233] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 23:22:58 2022] DELETE /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1/os-volume_attachments/d4eb1935-c1f2-42b9-9f1b-fdee4b6ab4c7 => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:22:59.351189 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8c84dada-9b59-433a-896a-b7ba4e91a67c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:59.352698 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8c84dada-9b59-433a-896a-b7ba4e91a67c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:59.359047 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c84dada-9b59-433a-896a-b7ba4e91a67c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:59.363091 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c84dada-9b59-433a-896a-b7ba4e91a67c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:59.363091 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c84dada-9b59-433a-896a-b7ba4e91a67c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:59.363091 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c84dada-9b59-433a-896a-b7ba4e91a67c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:59.363091 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c84dada-9b59-433a-896a-b7ba4e91a67c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:59.363448 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c84dada-9b59-433a-896a-b7ba4e91a67c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:59.512422 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8c84dada-9b59-433a-896a-b7ba4e91a67c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:59.512928 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a3ba56e2-0558-490d-a64f-81b5e3aa5f29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:59.513699 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a3ba56e2-0558-490d-a64f-81b5e3aa5f29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:59.520477 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8c84dada-9b59-433a-896a-b7ba4e91a67c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1501 microversion: 2.1 time: 0.173391 Sep 09 23:22:59.523790 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 126/234] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:59 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:22:59.523897 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3ba56e2-0558-490d-a64f-81b5e3aa5f29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:59.523897 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3ba56e2-0558-490d-a64f-81b5e3aa5f29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:59.524065 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3ba56e2-0558-490d-a64f-81b5e3aa5f29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:59.524755 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3ba56e2-0558-490d-a64f-81b5e3aa5f29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:59.525212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3ba56e2-0558-490d-a64f-81b5e3aa5f29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:59.525638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3ba56e2-0558-490d-a64f-81b5e3aa5f29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:59.543523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-cd09799f-eeba-48d4-a840-c331fc735b19 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a740de27-d9ab-45d6-bd9d-3f669c573de4"}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:22:59.545895 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-cd09799f-eeba-48d4-a840-c331fc735b19 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:59.552599 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd09799f-eeba-48d4-a840-c331fc735b19 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:59.553078 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd09799f-eeba-48d4-a840-c331fc735b19 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:59.553510 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd09799f-eeba-48d4-a840-c331fc735b19 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:59.554198 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd09799f-eeba-48d4-a840-c331fc735b19 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:59.554667 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd09799f-eeba-48d4-a840-c331fc735b19 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:59.555086 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd09799f-eeba-48d4-a840-c331fc735b19 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:59.578158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-cd09799f-eeba-48d4-a840-c331fc735b19 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] HTTP exception thrown: Cannot 'attach_volume' instance e2b8a715-050b-4cbd-aff9-747f65d1e8b5 while it is in vm_state rescued Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-cd09799f-eeba-48d4-a840-c331fc735b19 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Request method failure captured: Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: POST /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5/os-volume_attachments HTTP/1.1 Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 74 Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8pvNjLzJ26L_bDfYD8jco5ncLw5obm7RC4wRKucPyVFopv8LyYjnV_yhQPQAMGp6Zil82MDNt-pAuesw1hNYtsUzcK3dtyAhtCRZHB6fsXyFIBBtemCyksfm8yeHS53wmAq7bbGmXxhGwRUbZisQhpK4e3SQrT2dZnXAXnSUbLamlo Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 57759aec45f74a689727fca5fe201e40 Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-180796804 Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:22:59.580132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:22:59.581640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57759aec45f74a689727fca5fe201e40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57759aec45f74a689727fca5fe201e40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57759aec45f74a689727fca5fe201e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57759aec45f74a689727fca5fe201e40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:22:59.581640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-ServerRescueNegativeTestJSON-180796804 Sep 09 23:22:59.581640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 57759aec45f74a689727fca5fe201e40 Sep 09 23:22:59.581640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-180796804 Sep 09 23:22:59.581640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-ServerRescueNegativeTestJSON-180796804-project Sep 09 23:22:59.581640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:22:59.581640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:22:59.581640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 987d2f6bb1ff4f1fa248c3ff410c8119 Sep 09 23:22:59.581640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-ServerRescueNegativeTestJSON-180796804-project Sep 09 23:22:59.581640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Sep 09 23:22:59.581640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {"volumeAttachment": {"volumeId": "a740de27-d9ab-45d6-bd9d-3f669c573de4"}} Sep 09 23:22:59.581640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Cannot 'attach_volume' instance e2b8a715-050b-4cbd-aff9-747f65d1e8b5 while it is in vm_state rescued Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'server_id': 'e2b8a715-050b-4cbd-aff9-747f65d1e8b5', 'body': {'volumeAttachment': {'volumeId': 'a740de27-d9ab-45d6-bd9d-3f669c573de4'}}} Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e2b8a715-050b-4cbd-aff9-747f65d1e8b5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:22:59.582512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e2b8a715-050b-4cbd-aff9-747f65d1e8b5 while it is in vm_state rescued Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:22:59.583561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:22:59.584559 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:22:59.584559 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:22:59.584559 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e2b8a715-050b-4cbd-aff9-747f65d1e8b5 while it is in vm_state rescued Sep 09 23:22:59.584559 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:22:59.584559 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-cd09799f-eeba-48d4-a840-c331fc735b19 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Returning 409 to user: Cannot 'attach_volume' instance e2b8a715-050b-4cbd-aff9-747f65d1e8b5 while it is in vm_state rescued {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:22:59.584559 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-cd09799f-eeba-48d4-a840-c331fc735b19 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "POST /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041947 Sep 09 23:22:59.584559 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 127/235] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 23:22:59 2022] POST /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 09 23:22:59.590189 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d1d56721-f285-41fd-ad54-197fa298a7b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:22:59.590733 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d1d56721-f285-41fd-ad54-197fa298a7b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:59.597697 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d1d56721-f285-41fd-ad54-197fa298a7b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:59.598189 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d1d56721-f285-41fd-ad54-197fa298a7b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:59.598802 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d1d56721-f285-41fd-ad54-197fa298a7b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:59.599514 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d1d56721-f285-41fd-ad54-197fa298a7b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:59.599970 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d1d56721-f285-41fd-ad54-197fa298a7b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:59.600395 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d1d56721-f285-41fd-ad54-197fa298a7b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:59.666683 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a3ba56e2-0558-490d-a64f-81b5e3aa5f29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:59.675065 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a3ba56e2-0558-490d-a64f-81b5e3aa5f29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1314 microversion: 2.1 time: 0.166308 Sep 09 23:22:59.675579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 109/236] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:59 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:22:59.827990 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d1d56721-f285-41fd-ad54-197fa298a7b4 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "POST /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5/action" status: 202 len: 0 microversion: 2.1 time: 0.241174 Sep 09 23:22:59.828691 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 128/237] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 23:22:59 2022] POST /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 23:22:59.837236 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4bb27384-c293-4321-b663-17e92ed90e54 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:22:59.838089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4bb27384-c293-4321-b663-17e92ed90e54 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:22:59.846962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4bb27384-c293-4321-b663-17e92ed90e54 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:59.847337 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4bb27384-c293-4321-b663-17e92ed90e54 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:59.847944 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4bb27384-c293-4321-b663-17e92ed90e54 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:59.848809 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4bb27384-c293-4321-b663-17e92ed90e54 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:22:59.849408 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4bb27384-c293-4321-b663-17e92ed90e54 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:22:59.850199 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4bb27384-c293-4321-b663-17e92ed90e54 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:22:59.986528 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4bb27384-c293-4321-b663-17e92ed90e54 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:22:59.994219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4bb27384-c293-4321-b663-17e92ed90e54 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1509 microversion: 2.1 time: 0.161034 Sep 09 23:22:59.994818 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 110/238] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:22:59 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:00.231234 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-53b70729-12ac-4404-8797-0f9f516736c5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:00.231855 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-53b70729-12ac-4404-8797-0f9f516736c5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:00.239579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53b70729-12ac-4404-8797-0f9f516736c5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:00.240060 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53b70729-12ac-4404-8797-0f9f516736c5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:00.240500 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53b70729-12ac-4404-8797-0f9f516736c5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:00.241190 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53b70729-12ac-4404-8797-0f9f516736c5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:00.241641 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53b70729-12ac-4404-8797-0f9f516736c5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:00.242064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53b70729-12ac-4404-8797-0f9f516736c5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:00.372683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-53b70729-12ac-4404-8797-0f9f516736c5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:00.381036 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-53b70729-12ac-4404-8797-0f9f516736c5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:00.382511 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-53b70729-12ac-4404-8797-0f9f516736c5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:00.383616 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-53b70729-12ac-4404-8797-0f9f516736c5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.157064 Sep 09 23:23:00.384174 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 129/239] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:23:00 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:23:00.697641 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9917b4ef-f402-45ec-8298-e9b47972a5a2 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:00.698253 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9917b4ef-f402-45ec-8298-e9b47972a5a2 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:00.708174 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9917b4ef-f402-45ec-8298-e9b47972a5a2 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:00.709308 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9917b4ef-f402-45ec-8298-e9b47972a5a2 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:00.709955 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9917b4ef-f402-45ec-8298-e9b47972a5a2 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:00.711152 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9917b4ef-f402-45ec-8298-e9b47972a5a2 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:00.711828 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9917b4ef-f402-45ec-8298-e9b47972a5a2 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:00.712263 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9917b4ef-f402-45ec-8298-e9b47972a5a2 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:00.842946 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9917b4ef-f402-45ec-8298-e9b47972a5a2 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:00.851386 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9917b4ef-f402-45ec-8298-e9b47972a5a2 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1314 microversion: 2.1 time: 0.157591 Sep 09 23:23:00.851952 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 111/240] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:00 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:01.018793 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-cf17d481-6547-4bbf-9e25-fcd1214e437f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:01.019327 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-cf17d481-6547-4bbf-9e25-fcd1214e437f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:01.025167 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cf17d481-6547-4bbf-9e25-fcd1214e437f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:01.025647 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cf17d481-6547-4bbf-9e25-fcd1214e437f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:01.031557 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cf17d481-6547-4bbf-9e25-fcd1214e437f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:01.031557 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cf17d481-6547-4bbf-9e25-fcd1214e437f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:01.031557 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cf17d481-6547-4bbf-9e25-fcd1214e437f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:01.031557 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cf17d481-6547-4bbf-9e25-fcd1214e437f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:01.155449 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cf17d481-6547-4bbf-9e25-fcd1214e437f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:01.163778 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-cf17d481-6547-4bbf-9e25-fcd1214e437f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1509 microversion: 2.1 time: 0.149689 Sep 09 23:23:01.164340 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 130/241] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:01 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:01.408715 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4ec9d9ad-a98b-4b79-bbfd-646e8d24174d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:01.409361 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4ec9d9ad-a98b-4b79-bbfd-646e8d24174d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:01.415514 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4ec9d9ad-a98b-4b79-bbfd-646e8d24174d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:01.416002 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4ec9d9ad-a98b-4b79-bbfd-646e8d24174d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:01.418096 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4ec9d9ad-a98b-4b79-bbfd-646e8d24174d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:01.418096 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4ec9d9ad-a98b-4b79-bbfd-646e8d24174d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:01.418096 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4ec9d9ad-a98b-4b79-bbfd-646e8d24174d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:01.418096 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4ec9d9ad-a98b-4b79-bbfd-646e8d24174d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:01.422435 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:01.549778 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4ec9d9ad-a98b-4b79-bbfd-646e8d24174d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:01.558114 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4ec9d9ad-a98b-4b79-bbfd-646e8d24174d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:01.559605 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4ec9d9ad-a98b-4b79-bbfd-646e8d24174d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:01.560707 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4ec9d9ad-a98b-4b79-bbfd-646e8d24174d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1402 microversion: 2.20 time: 0.156150 Sep 09 23:23:01.561273 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 112/242] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:23:01 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1402 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:23:01.874728 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a0f9db86-e3cd-4a95-b175-c507f1d351eb tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:01.879094 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a0f9db86-e3cd-4a95-b175-c507f1d351eb tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:01.881926 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a0f9db86-e3cd-4a95-b175-c507f1d351eb tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:01.882432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a0f9db86-e3cd-4a95-b175-c507f1d351eb tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:01.882861 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a0f9db86-e3cd-4a95-b175-c507f1d351eb tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:01.883541 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a0f9db86-e3cd-4a95-b175-c507f1d351eb tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:01.883989 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a0f9db86-e3cd-4a95-b175-c507f1d351eb tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:01.884407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a0f9db86-e3cd-4a95-b175-c507f1d351eb tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:02.012233 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a0f9db86-e3cd-4a95-b175-c507f1d351eb tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:02.020649 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a0f9db86-e3cd-4a95-b175-c507f1d351eb tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1314 microversion: 2.1 time: 0.150027 Sep 09 23:23:02.022625 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 131/243] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:01 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:02.188343 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-eaa5723c-8dc8-497d-a4fc-e0632eadb44b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:02.189854 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-eaa5723c-8dc8-497d-a4fc-e0632eadb44b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:02.195963 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eaa5723c-8dc8-497d-a4fc-e0632eadb44b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:02.196759 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eaa5723c-8dc8-497d-a4fc-e0632eadb44b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:02.201304 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eaa5723c-8dc8-497d-a4fc-e0632eadb44b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:02.201304 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eaa5723c-8dc8-497d-a4fc-e0632eadb44b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:02.201304 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eaa5723c-8dc8-497d-a4fc-e0632eadb44b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:02.201304 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eaa5723c-8dc8-497d-a4fc-e0632eadb44b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:02.345461 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-eaa5723c-8dc8-497d-a4fc-e0632eadb44b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:02.351708 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-eaa5723c-8dc8-497d-a4fc-e0632eadb44b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1509 microversion: 2.1 time: 0.167651 Sep 09 23:23:02.352290 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 113/244] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:02 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:02.584969 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-327f5b9c-b2ec-40e6-ba77-d032f48e75e2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:02.585567 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-327f5b9c-b2ec-40e6-ba77-d032f48e75e2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:02.591455 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-327f5b9c-b2ec-40e6-ba77-d032f48e75e2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:02.591927 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-327f5b9c-b2ec-40e6-ba77-d032f48e75e2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:02.592356 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-327f5b9c-b2ec-40e6-ba77-d032f48e75e2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:02.593039 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-327f5b9c-b2ec-40e6-ba77-d032f48e75e2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:02.593484 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-327f5b9c-b2ec-40e6-ba77-d032f48e75e2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:02.593903 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-327f5b9c-b2ec-40e6-ba77-d032f48e75e2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:02.733198 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-327f5b9c-b2ec-40e6-ba77-d032f48e75e2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:02.741960 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-327f5b9c-b2ec-40e6-ba77-d032f48e75e2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:02.743476 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-327f5b9c-b2ec-40e6-ba77-d032f48e75e2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:02.744673 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-327f5b9c-b2ec-40e6-ba77-d032f48e75e2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1593 microversion: 2.20 time: 0.163530 Sep 09 23:23:02.745282 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 132/245] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:23:02 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1593 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:23:02.772762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7f15a7aa-41c0-4eec-a65a-942cb20022d8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:02.773510 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7f15a7aa-41c0-4eec-a65a-942cb20022d8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:02.779868 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f15a7aa-41c0-4eec-a65a-942cb20022d8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:02.780432 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f15a7aa-41c0-4eec-a65a-942cb20022d8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:02.781100 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f15a7aa-41c0-4eec-a65a-942cb20022d8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:02.782799 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f15a7aa-41c0-4eec-a65a-942cb20022d8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:02.783549 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f15a7aa-41c0-4eec-a65a-942cb20022d8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:02.784275 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f15a7aa-41c0-4eec-a65a-942cb20022d8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:02.871740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7f15a7aa-41c0-4eec-a65a-942cb20022d8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.104802 Sep 09 23:23:02.872590 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 114/246] 10.222.0.20 () {60 vars in 1316 bytes} [Fri Sep 9 23:23:02 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:23:03.043951 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e575ae65-ca96-4fcb-b296-b5715405d507 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:03.044560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e575ae65-ca96-4fcb-b296-b5715405d507 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:03.051113 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e575ae65-ca96-4fcb-b296-b5715405d507 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:03.051823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e575ae65-ca96-4fcb-b296-b5715405d507 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:03.052248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e575ae65-ca96-4fcb-b296-b5715405d507 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:03.053163 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e575ae65-ca96-4fcb-b296-b5715405d507 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:03.053604 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e575ae65-ca96-4fcb-b296-b5715405d507 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:03.054378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e575ae65-ca96-4fcb-b296-b5715405d507 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:03.377149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a3500ea9-210b-4946-a390-d1caafca48a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:03.377831 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a3500ea9-210b-4946-a390-d1caafca48a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:03.382645 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e575ae65-ca96-4fcb-b296-b5715405d507 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:03.385845 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3500ea9-210b-4946-a390-d1caafca48a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:03.386360 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3500ea9-210b-4946-a390-d1caafca48a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:03.386807 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3500ea9-210b-4946-a390-d1caafca48a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:03.392528 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3500ea9-210b-4946-a390-d1caafca48a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:03.392528 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3500ea9-210b-4946-a390-d1caafca48a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:03.392528 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3500ea9-210b-4946-a390-d1caafca48a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:03.392794 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e575ae65-ca96-4fcb-b296-b5715405d507 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1314 microversion: 2.1 time: 0.351479 Sep 09 23:23:03.409277 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 133/247] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:03 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:03.543241 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a3500ea9-210b-4946-a390-d1caafca48a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:03.553445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a3500ea9-210b-4946-a390-d1caafca48a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1509 microversion: 2.1 time: 0.180747 Sep 09 23:23:03.558835 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 115/248] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:03 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:04.424494 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4c46517e-f0a2-4a08-a0a5-b64ea6ca3ccd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:04.425311 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4c46517e-f0a2-4a08-a0a5-b64ea6ca3ccd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:04.431533 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c46517e-f0a2-4a08-a0a5-b64ea6ca3ccd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:04.432078 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c46517e-f0a2-4a08-a0a5-b64ea6ca3ccd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:04.432846 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c46517e-f0a2-4a08-a0a5-b64ea6ca3ccd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:04.439775 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c46517e-f0a2-4a08-a0a5-b64ea6ca3ccd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:04.439775 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c46517e-f0a2-4a08-a0a5-b64ea6ca3ccd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:04.439775 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c46517e-f0a2-4a08-a0a5-b64ea6ca3ccd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:04.584161 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-39c7d238-f998-4234-b8c5-4f82639ef713 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:04.585382 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-39c7d238-f998-4234-b8c5-4f82639ef713 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:04.591929 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39c7d238-f998-4234-b8c5-4f82639ef713 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:04.592617 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39c7d238-f998-4234-b8c5-4f82639ef713 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:04.593060 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39c7d238-f998-4234-b8c5-4f82639ef713 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:04.594763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39c7d238-f998-4234-b8c5-4f82639ef713 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:04.594763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39c7d238-f998-4234-b8c5-4f82639ef713 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:04.594763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39c7d238-f998-4234-b8c5-4f82639ef713 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:04.618750 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4c46517e-f0a2-4a08-a0a5-b64ea6ca3ccd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:04.630092 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4c46517e-f0a2-4a08-a0a5-b64ea6ca3ccd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1314 microversion: 2.1 time: 0.216634 Sep 09 23:23:04.630698 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 134/249] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:04 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:04.635537 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-b048b8f1-abdb-4518-96b7-f3aeaf1cd3f0 req-5a68be05-a308-4b06-b6fa-107c41fa5308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a8b2e1-79be-4c0d-b316-94c95ae04638", "tag": "a8c73f48-9a44-48f9-9123-64c486486e8b"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:04.659009 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-b048b8f1-abdb-4518-96b7-f3aeaf1cd3f0 req-5a68be05-a308-4b06-b6fa-107c41fa5308 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:04.659674 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-b048b8f1-abdb-4518-96b7-f3aeaf1cd3f0 req-5a68be05-a308-4b06-b6fa-107c41fa5308 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:04.660265 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-b048b8f1-abdb-4518-96b7-f3aeaf1cd3f0 req-5a68be05-a308-4b06-b6fa-107c41fa5308 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:04.672403 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-b048b8f1-abdb-4518-96b7-f3aeaf1cd3f0 req-5a68be05-a308-4b06-b6fa-107c41fa5308 service nova] Creating event network-changed:a8c73f48-9a44-48f9-9123-64c486486e8b for instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 on hv-cinder-85032 Sep 09 23:23:04.679587 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-b048b8f1-abdb-4518-96b7-f3aeaf1cd3f0 req-5a68be05-a308-4b06-b6fa-107c41fa5308 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047112 Sep 09 23:23:04.684251 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 135/250] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:23:04.797252 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-39c7d238-f998-4234-b8c5-4f82639ef713 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:04.806004 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-39c7d238-f998-4234-b8c5-4f82639ef713 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1509 microversion: 2.1 time: 0.226411 Sep 09 23:23:04.811978 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 116/251] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:04 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:05.264147 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-39858b1b-40ef-4898-ac4e-e731b63bc158 req-96a7767c-7e85-4868-9fe5-597a6682a633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429d85b0-48f0-43c4-91df-43c474018d06", "name": "network-vif-plugged", "status": "completed", "tag": "e39db3e3-406c-4eda-ab71-1d721a17ed2b"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:05.274578 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-39858b1b-40ef-4898-ac4e-e731b63bc158 req-96a7767c-7e85-4868-9fe5-597a6682a633 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:05.275250 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-39858b1b-40ef-4898-ac4e-e731b63bc158 req-96a7767c-7e85-4868-9fe5-597a6682a633 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:05.275858 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-39858b1b-40ef-4898-ac4e-e731b63bc158 req-96a7767c-7e85-4868-9fe5-597a6682a633 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:05.292208 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-39858b1b-40ef-4898-ac4e-e731b63bc158 req-96a7767c-7e85-4868-9fe5-597a6682a633 service nova] Creating event network-vif-plugged:e39db3e3-406c-4eda-ab71-1d721a17ed2b for instance 429d85b0-48f0-43c4-91df-43c474018d06 on hv-cinder-85032 Sep 09 23:23:05.298840 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-39858b1b-40ef-4898-ac4e-e731b63bc158 req-96a7767c-7e85-4868-9fe5-597a6682a633 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037947 Sep 09 23:23:05.300070 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 136/252] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:23:05.652926 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-37b85563-1042-4fdf-be4a-368962e371ba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:05.660181 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-37b85563-1042-4fdf-be4a-368962e371ba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:05.661014 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37b85563-1042-4fdf-be4a-368962e371ba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:05.661494 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37b85563-1042-4fdf-be4a-368962e371ba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:05.661927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37b85563-1042-4fdf-be4a-368962e371ba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:05.662637 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37b85563-1042-4fdf-be4a-368962e371ba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:05.663086 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37b85563-1042-4fdf-be4a-368962e371ba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:05.663501 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37b85563-1042-4fdf-be4a-368962e371ba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:05.847721 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-61f467e7-1eb8-41d3-9520-b56d358e41d3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:05.849084 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-61f467e7-1eb8-41d3-9520-b56d358e41d3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:05.858424 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-61f467e7-1eb8-41d3-9520-b56d358e41d3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:05.861329 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-61f467e7-1eb8-41d3-9520-b56d358e41d3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:05.866520 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-61f467e7-1eb8-41d3-9520-b56d358e41d3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:05.869543 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-61f467e7-1eb8-41d3-9520-b56d358e41d3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:05.870191 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-61f467e7-1eb8-41d3-9520-b56d358e41d3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:05.870984 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-61f467e7-1eb8-41d3-9520-b56d358e41d3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:05.874993 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-37b85563-1042-4fdf-be4a-368962e371ba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:05.883382 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-37b85563-1042-4fdf-be4a-368962e371ba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1314 microversion: 2.1 time: 0.234155 Sep 09 23:23:05.903433 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 117/253] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:05 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:05.909465 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:06.140125 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-61f467e7-1eb8-41d3-9520-b56d358e41d3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:06.148150 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-61f467e7-1eb8-41d3-9520-b56d358e41d3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1515 microversion: 2.1 time: 0.322366 Sep 09 23:23:06.148900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 137/254] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:05 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1515 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:06.490948 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-65ea20d1-21fc-45d5-8578-9fb606756474 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:06.501602 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65ea20d1-21fc-45d5-8578-9fb606756474 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:06.501602 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65ea20d1-21fc-45d5-8578-9fb606756474 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:06.501602 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65ea20d1-21fc-45d5-8578-9fb606756474 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:06.569515 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-65ea20d1-21fc-45d5-8578-9fb606756474 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Going to try to stop instance {{(pid=121058) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 23:23:06.828058 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-65ea20d1-21fc-45d5-8578-9fb606756474 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "POST /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/action" status: 202 len: 0 microversion: 2.1 time: 0.340992 Sep 09 23:23:06.834149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 118/255] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 23:23:06 2022] POST /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:23:06.841141 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-73f6834b-a33f-4768-bf47-ba57c7a8474e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:06.841990 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-73f6834b-a33f-4768-bf47-ba57c7a8474e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:06.848557 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-73f6834b-a33f-4768-bf47-ba57c7a8474e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:06.849119 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-73f6834b-a33f-4768-bf47-ba57c7a8474e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:06.849483 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-73f6834b-a33f-4768-bf47-ba57c7a8474e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:06.850189 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-73f6834b-a33f-4768-bf47-ba57c7a8474e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:06.850772 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-73f6834b-a33f-4768-bf47-ba57c7a8474e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:06.851200 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-73f6834b-a33f-4768-bf47-ba57c7a8474e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:06.913454 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-03c83d16-6eb8-4563-b4a5-41483bfb7393 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:06.914434 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-03c83d16-6eb8-4563-b4a5-41483bfb7393 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:06.921187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-03c83d16-6eb8-4563-b4a5-41483bfb7393 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:06.921880 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-03c83d16-6eb8-4563-b4a5-41483bfb7393 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:06.922544 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-03c83d16-6eb8-4563-b4a5-41483bfb7393 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:06.923464 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-03c83d16-6eb8-4563-b4a5-41483bfb7393 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:06.924072 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-03c83d16-6eb8-4563-b4a5-41483bfb7393 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:06.924663 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-03c83d16-6eb8-4563-b4a5-41483bfb7393 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:06.996017 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-73f6834b-a33f-4768-bf47-ba57c7a8474e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:07.005381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-73f6834b-a33f-4768-bf47-ba57c7a8474e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.168160 Sep 09 23:23:07.005955 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 138/256] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:06 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:07.061886 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-03c83d16-6eb8-4563-b4a5-41483bfb7393 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:07.070618 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-03c83d16-6eb8-4563-b4a5-41483bfb7393 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1314 microversion: 2.1 time: 0.161260 Sep 09 23:23:07.071400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 119/257] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:06 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:07.943437 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7e298904-96c3-456f-b000-49340d47b5aa tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Action: 'create', calling method: .version_select at 0x7f908dfd01f0>, body: {"keypair": {"name": "tempest-keypair-369746703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGVhGCCl/fABeBkEFPoEOGVdfVSINU8ohj3F9RnD/+sWtpgEX5U32mQJP6foBrCqeIC48aRCILfbhmaMXePN9aZDQ07VeuU4VsT9ZdZCm/Thz/iABtbJIYcT0nkVUJcVg=="}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:07.959644 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-7e298904-96c3-456f-b000-49340d47b5aa tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Getting quotas for project 57759aec45f74a689727fca5fe201e40. Resources: {'key_pairs'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:23:07.964160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-7e298904-96c3-456f-b000-49340d47b5aa tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Getting quotas for user 987d2f6bb1ff4f1fa248c3ff410c8119 and project 57759aec45f74a689727fca5fe201e40. Resources: {'key_pairs'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:23:07.988256 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7844b4d7-6c2b-4125-94a3-914c6c5a1099 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:07.989481 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7844b4d7-6c2b-4125-94a3-914c6c5a1099 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:07.995846 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7844b4d7-6c2b-4125-94a3-914c6c5a1099 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:07.996333 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7844b4d7-6c2b-4125-94a3-914c6c5a1099 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:07.996883 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7844b4d7-6c2b-4125-94a3-914c6c5a1099 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:07.997580 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7844b4d7-6c2b-4125-94a3-914c6c5a1099 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:07.998151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7844b4d7-6c2b-4125-94a3-914c6c5a1099 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:07.998604 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7844b4d7-6c2b-4125-94a3-914c6c5a1099 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:08.026490 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7844b4d7-6c2b-4125-94a3-914c6c5a1099 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Going to try to terminate instance {{(pid=121058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:23:08.043438 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7e298904-96c3-456f-b000-49340d47b5aa tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.104221 Sep 09 23:23:08.050923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 139/258] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 23:23:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:23:08.050923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f5e6da77-c434-4a1b-a74e-005709b4b792 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:08.051133 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f5e6da77-c434-4a1b-a74e-005709b4b792 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:08.057152 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f5e6da77-c434-4a1b-a74e-005709b4b792 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:08.057698 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f5e6da77-c434-4a1b-a74e-005709b4b792 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:08.058374 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f5e6da77-c434-4a1b-a74e-005709b4b792 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:08.059274 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f5e6da77-c434-4a1b-a74e-005709b4b792 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:08.060046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f5e6da77-c434-4a1b-a74e-005709b4b792 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:08.060768 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f5e6da77-c434-4a1b-a74e-005709b4b792 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:08.193183 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f5e6da77-c434-4a1b-a74e-005709b4b792 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:08.201342 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f5e6da77-c434-4a1b-a74e-005709b4b792 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.155453 Sep 09 23:23:08.206144 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 140/259] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:08 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:08.213292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b81b9af2-2940-4d50-8e02-b95c8bc0b36e tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:08.213292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b81b9af2-2940-4d50-8e02-b95c8bc0b36e tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:08.220494 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b81b9af2-2940-4d50-8e02-b95c8bc0b36e tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:08.221558 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b81b9af2-2940-4d50-8e02-b95c8bc0b36e tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:08.222281 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b81b9af2-2940-4d50-8e02-b95c8bc0b36e tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:08.223036 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b81b9af2-2940-4d50-8e02-b95c8bc0b36e tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:08.224141 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b81b9af2-2940-4d50-8e02-b95c8bc0b36e tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:08.224141 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b81b9af2-2940-4d50-8e02-b95c8bc0b36e tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:08.376127 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7844b4d7-6c2b-4125-94a3-914c6c5a1099 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 204 len: 0 microversion: 2.1 time: 0.392376 Sep 09 23:23:08.376697 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 120/260] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:23:07 2022] DELETE /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 23:23:08.385415 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-57c91291-7083-43c4-81a1-f53c95b76b65 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:08.386444 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-57c91291-7083-43c4-81a1-f53c95b76b65 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:08.392654 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-57c91291-7083-43c4-81a1-f53c95b76b65 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:08.393327 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b81b9af2-2940-4d50-8e02-b95c8bc0b36e tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:08.393800 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-57c91291-7083-43c4-81a1-f53c95b76b65 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:08.394531 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-57c91291-7083-43c4-81a1-f53c95b76b65 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:08.395880 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-57c91291-7083-43c4-81a1-f53c95b76b65 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:08.396342 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-57c91291-7083-43c4-81a1-f53c95b76b65 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:08.396985 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-57c91291-7083-43c4-81a1-f53c95b76b65 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:08.402653 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b81b9af2-2940-4d50-8e02-b95c8bc0b36e tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1498 microversion: 2.1 time: 0.195682 Sep 09 23:23:08.403531 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 141/261] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:08 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1498 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:08.552562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-57c91291-7083-43c4-81a1-f53c95b76b65 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:08.560257 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-57c91291-7083-43c4-81a1-f53c95b76b65 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1515 microversion: 2.1 time: 0.178878 Sep 09 23:23:08.560829 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 121/262] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:08 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:09.225579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4a7a86af-5d55-4cf7-a536-413528b19967 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:09.226188 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4a7a86af-5d55-4cf7-a536-413528b19967 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:09.233181 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a7a86af-5d55-4cf7-a536-413528b19967 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:09.233600 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a7a86af-5d55-4cf7-a536-413528b19967 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:09.234032 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a7a86af-5d55-4cf7-a536-413528b19967 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:09.234745 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a7a86af-5d55-4cf7-a536-413528b19967 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:09.235193 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a7a86af-5d55-4cf7-a536-413528b19967 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:09.235608 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a7a86af-5d55-4cf7-a536-413528b19967 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:09.435398 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4a7a86af-5d55-4cf7-a536-413528b19967 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:09.444430 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4a7a86af-5d55-4cf7-a536-413528b19967 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.222910 Sep 09 23:23:09.445005 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 142/263] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:09 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:09.584967 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e80f2108-7326-4d10-ad00-7acb8c092121 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:09.585591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e80f2108-7326-4d10-ad00-7acb8c092121 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:09.592479 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e80f2108-7326-4d10-ad00-7acb8c092121 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:09.593003 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e80f2108-7326-4d10-ad00-7acb8c092121 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:09.593545 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e80f2108-7326-4d10-ad00-7acb8c092121 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:09.594253 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e80f2108-7326-4d10-ad00-7acb8c092121 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:09.594796 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e80f2108-7326-4d10-ad00-7acb8c092121 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:09.595234 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e80f2108-7326-4d10-ad00-7acb8c092121 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:09.643118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b84992c6-6ebd-43c6-a870-e1b2cc4ed20b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:09.643718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b84992c6-6ebd-43c6-a870-e1b2cc4ed20b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:09.651240 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b84992c6-6ebd-43c6-a870-e1b2cc4ed20b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:09.651729 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b84992c6-6ebd-43c6-a870-e1b2cc4ed20b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:09.652370 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b84992c6-6ebd-43c6-a870-e1b2cc4ed20b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:09.653263 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b84992c6-6ebd-43c6-a870-e1b2cc4ed20b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:09.653712 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b84992c6-6ebd-43c6-a870-e1b2cc4ed20b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:09.654424 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b84992c6-6ebd-43c6-a870-e1b2cc4ed20b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:09.681626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b84992c6-6ebd-43c6-a870-e1b2cc4ed20b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Going to try to terminate instance {{(pid=121059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:23:09.744349 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e80f2108-7326-4d10-ad00-7acb8c092121 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:09.752132 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e80f2108-7326-4d10-ad00-7acb8c092121 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1515 microversion: 2.1 time: 0.172728 Sep 09 23:23:09.753911 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 122/264] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:09 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:10.009215 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b84992c6-6ebd-43c6-a870-e1b2cc4ed20b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "DELETE /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 204 len: 0 microversion: 2.1 time: 0.379097 Sep 09 23:23:10.011233 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 143/265] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:23:09 2022] DELETE /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 23:23:10.022323 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e487b3f2-b037-404d-b41e-3d7979f48ad6 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:10.022956 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e487b3f2-b037-404d-b41e-3d7979f48ad6 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:10.029132 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e487b3f2-b037-404d-b41e-3d7979f48ad6 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:10.029793 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e487b3f2-b037-404d-b41e-3d7979f48ad6 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:10.030225 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e487b3f2-b037-404d-b41e-3d7979f48ad6 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:10.031065 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e487b3f2-b037-404d-b41e-3d7979f48ad6 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:10.031525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e487b3f2-b037-404d-b41e-3d7979f48ad6 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:10.031949 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e487b3f2-b037-404d-b41e-3d7979f48ad6 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:10.167543 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e487b3f2-b037-404d-b41e-3d7979f48ad6 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:10.176089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e487b3f2-b037-404d-b41e-3d7979f48ad6 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1504 microversion: 2.1 time: 0.157925 Sep 09 23:23:10.176892 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 123/266] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:10 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:10.469143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-94767163-a3aa-4ab4-9a4c-504f94881829 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:10.469964 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-94767163-a3aa-4ab4-9a4c-504f94881829 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:10.477280 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-94767163-a3aa-4ab4-9a4c-504f94881829 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:10.477772 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-94767163-a3aa-4ab4-9a4c-504f94881829 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:10.478215 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-94767163-a3aa-4ab4-9a4c-504f94881829 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:10.478961 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-94767163-a3aa-4ab4-9a4c-504f94881829 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:10.479419 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-94767163-a3aa-4ab4-9a4c-504f94881829 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:10.479849 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-94767163-a3aa-4ab4-9a4c-504f94881829 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:10.578352 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-193267004", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4076ec75-3b9f-4f28-96bf-84fd670013ed"}], "security_groups": [{"name": "tempest-securitygroup--1027617524"}], "key_name": "tempest-keypair-369746703", "user_data": "}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:10.694311 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.network.neutron [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] validate_networks() for [('4076ec75-3b9f-4f28-96bf-84fd670013ed', None, None, None, None, None)] {{(pid=121058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:23:10.849651 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-94767163-a3aa-4ab4-9a4c-504f94881829 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:10.858450 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-94767163-a3aa-4ab4-9a4c-504f94881829 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.393483 Sep 09 23:23:10.859021 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 144/267] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:10 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:10.871697 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-dd91801f-328b-4e25-8b2b-825ca7dc618f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:10.872447 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-dd91801f-328b-4e25-8b2b-825ca7dc618f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:10.878697 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dd91801f-328b-4e25-8b2b-825ca7dc618f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:10.879193 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dd91801f-328b-4e25-8b2b-825ca7dc618f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:10.879698 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dd91801f-328b-4e25-8b2b-825ca7dc618f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:10.880461 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dd91801f-328b-4e25-8b2b-825ca7dc618f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:10.881011 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dd91801f-328b-4e25-8b2b-825ca7dc618f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:10.881500 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dd91801f-328b-4e25-8b2b-825ca7dc618f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:11.009358 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-dd91801f-328b-4e25-8b2b-825ca7dc618f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:11.017073 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-dd91801f-328b-4e25-8b2b-825ca7dc618f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1515 microversion: 2.1 time: 0.149223 Sep 09 23:23:11.017645 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 145/268] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:10 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:11.084587 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Flavor limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:23:11.085013 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Image limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:23:11.085483 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Flavor pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:23:11.085923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Image pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:23:11.086333 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:23:11.095043 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:11.098051 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:11.098051 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:11.098051 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:11.098051 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:11.098415 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:11.115230 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Getting quotas for project 57759aec45f74a689727fca5fe201e40. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:23:11.119218 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Getting quotas for user 987d2f6bb1ff4f1fa248c3ff410c8119 and project 57759aec45f74a689727fca5fe201e40. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:23:11.132420 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Going to run 1 instances... {{(pid=121058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:23:11.133289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:23:11.200006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-9f54c627-9cf4-4a85-84b3-49760d1e9e96 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:11.200006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-9f54c627-9cf4-4a85-84b3-49760d1e9e96 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:11.209445 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f54c627-9cf4-4a85-84b3-49760d1e9e96 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:11.209944 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f54c627-9cf4-4a85-84b3-49760d1e9e96 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:11.210584 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f54c627-9cf4-4a85-84b3-49760d1e9e96 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:11.212211 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f54c627-9cf4-4a85-84b3-49760d1e9e96 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:11.212678 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f54c627-9cf4-4a85-84b3-49760d1e9e96 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:11.213115 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f54c627-9cf4-4a85-84b3-49760d1e9e96 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:11.265267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e7dea4c9-bb81-431b-8f61-191d722862f8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.691055 Sep 09 23:23:11.265926 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 124/269] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:23:10 2022] POST /compute/v2.1/servers => generated 409 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 23:23:11.278129 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8ac96625-fb86-4b38-93ed-2a40528bc5f0 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:11.278820 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8ac96625-fb86-4b38-93ed-2a40528bc5f0 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:11.344918 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8ac96625-fb86-4b38-93ed-2a40528bc5f0 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:11.353725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8ac96625-fb86-4b38-93ed-2a40528bc5f0 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1244 microversion: 2.1 time: 0.079346 Sep 09 23:23:11.354618 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 125/270] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:11 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:11.371437 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-9f54c627-9cf4-4a85-84b3-49760d1e9e96 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:11.380850 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-9f54c627-9cf4-4a85-84b3-49760d1e9e96 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1504 microversion: 2.1 time: 0.185303 Sep 09 23:23:11.381421 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 146/271] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:11 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:11.882518 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-dff2ec6e-084d-48d6-ae69-0b023f399f73 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:11.883171 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-dff2ec6e-084d-48d6-ae69-0b023f399f73 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:11.889814 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dff2ec6e-084d-48d6-ae69-0b023f399f73 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:11.890298 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dff2ec6e-084d-48d6-ae69-0b023f399f73 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:11.896079 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dff2ec6e-084d-48d6-ae69-0b023f399f73 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:11.896079 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dff2ec6e-084d-48d6-ae69-0b023f399f73 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:11.896079 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dff2ec6e-084d-48d6-ae69-0b023f399f73 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:11.896079 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dff2ec6e-084d-48d6-ae69-0b023f399f73 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:12.022030 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-dff2ec6e-084d-48d6-ae69-0b023f399f73 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:12.030419 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-dff2ec6e-084d-48d6-ae69-0b023f399f73 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.151938 Sep 09 23:23:12.030993 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 126/272] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:11 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:12.040920 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-370dc0bf-82f4-4cf1-abea-d40023ef257e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:12.041530 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-370dc0bf-82f4-4cf1-abea-d40023ef257e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:12.047891 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-370dc0bf-82f4-4cf1-abea-d40023ef257e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:12.048372 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-370dc0bf-82f4-4cf1-abea-d40023ef257e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:12.048810 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-370dc0bf-82f4-4cf1-abea-d40023ef257e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:12.050029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-370dc0bf-82f4-4cf1-abea-d40023ef257e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:12.050540 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-370dc0bf-82f4-4cf1-abea-d40023ef257e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:12.051019 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-370dc0bf-82f4-4cf1-abea-d40023ef257e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:12.379170 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-fd6d66df-e60b-414a-bdcc-aa3f2a71ecda tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:12.380150 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-fd6d66df-e60b-414a-bdcc-aa3f2a71ecda tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:12.386513 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd6d66df-e60b-414a-bdcc-aa3f2a71ecda tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:12.387088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd6d66df-e60b-414a-bdcc-aa3f2a71ecda tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:12.387590 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd6d66df-e60b-414a-bdcc-aa3f2a71ecda tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:12.388372 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd6d66df-e60b-414a-bdcc-aa3f2a71ecda tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:12.389053 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd6d66df-e60b-414a-bdcc-aa3f2a71ecda tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:12.389671 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd6d66df-e60b-414a-bdcc-aa3f2a71ecda tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:12.402226 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-370dc0bf-82f4-4cf1-abea-d40023ef257e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:12.422010 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-370dc0bf-82f4-4cf1-abea-d40023ef257e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1515 microversion: 2.1 time: 0.384833 Sep 09 23:23:12.426909 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 147/273] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:12 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1515 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:12.441482 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-315aa711-a499-47d5-a22b-71fedc7b2243 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:12.442106 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-315aa711-a499-47d5-a22b-71fedc7b2243 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:12.451509 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-315aa711-a499-47d5-a22b-71fedc7b2243 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:12.452310 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-315aa711-a499-47d5-a22b-71fedc7b2243 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:12.452759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-315aa711-a499-47d5-a22b-71fedc7b2243 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:12.453658 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-315aa711-a499-47d5-a22b-71fedc7b2243 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:12.454118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-315aa711-a499-47d5-a22b-71fedc7b2243 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:12.454742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-315aa711-a499-47d5-a22b-71fedc7b2243 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:12.688748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-315aa711-a499-47d5-a22b-71fedc7b2243 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:12.721425 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-315aa711-a499-47d5-a22b-71fedc7b2243 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1504 microversion: 2.1 time: 0.275733 Sep 09 23:23:12.722378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 148/274] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:12 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:12.773605 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-fd6d66df-e60b-414a-bdcc-aa3f2a71ecda tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:12.781064 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-fd6d66df-e60b-414a-bdcc-aa3f2a71ecda tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1248 microversion: 2.1 time: 0.406372 Sep 09 23:23:12.797265 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 127/275] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:12 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1248 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:13.055917 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3be4bea5-8751-4cbe-8826-ce41f2ea56e3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:13.057512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3be4bea5-8751-4cbe-8826-ce41f2ea56e3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:13.065554 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3be4bea5-8751-4cbe-8826-ce41f2ea56e3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:13.066261 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3be4bea5-8751-4cbe-8826-ce41f2ea56e3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:13.066812 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3be4bea5-8751-4cbe-8826-ce41f2ea56e3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:13.069001 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3be4bea5-8751-4cbe-8826-ce41f2ea56e3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:13.069644 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3be4bea5-8751-4cbe-8826-ce41f2ea56e3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:13.070088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3be4bea5-8751-4cbe-8826-ce41f2ea56e3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:13.259270 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3be4bea5-8751-4cbe-8826-ce41f2ea56e3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:13.267592 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3be4bea5-8751-4cbe-8826-ce41f2ea56e3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.218423 Sep 09 23:23:13.268967 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 149/276] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:13 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:13.447375 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-75152145-a8ee-4b24-87f0-7ae67599e584 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:13.448533 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-75152145-a8ee-4b24-87f0-7ae67599e584 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:13.456919 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-75152145-a8ee-4b24-87f0-7ae67599e584 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:13.457412 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-75152145-a8ee-4b24-87f0-7ae67599e584 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:13.457841 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-75152145-a8ee-4b24-87f0-7ae67599e584 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:13.458641 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-75152145-a8ee-4b24-87f0-7ae67599e584 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:13.459087 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-75152145-a8ee-4b24-87f0-7ae67599e584 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:13.459509 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-75152145-a8ee-4b24-87f0-7ae67599e584 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:13.462693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:13.472145 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-289a516c-0e1a-42a5-8ccd-d186cbd79fe2 req-58691ae4-c2a9-4935-9d8c-fb4fb4dcce03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0083662b-22d2-4477-af67-902c53f634a1", "name": "network-vif-deleted", "tag": "53c6df5b-659f-4e54-8526-ec81f3cbe286"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:13.482960 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-289a516c-0e1a-42a5-8ccd-d186cbd79fe2 req-58691ae4-c2a9-4935-9d8c-fb4fb4dcce03 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:13.483516 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-289a516c-0e1a-42a5-8ccd-d186cbd79fe2 req-58691ae4-c2a9-4935-9d8c-fb4fb4dcce03 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:13.484016 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-289a516c-0e1a-42a5-8ccd-d186cbd79fe2 req-58691ae4-c2a9-4935-9d8c-fb4fb4dcce03 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:13.494948 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-289a516c-0e1a-42a5-8ccd-d186cbd79fe2 req-58691ae4-c2a9-4935-9d8c-fb4fb4dcce03 service nova] Creating event network-vif-deleted:53c6df5b-659f-4e54-8526-ec81f3cbe286 for instance 0083662b-22d2-4477-af67-902c53f634a1 on hv-cinder-85032 Sep 09 23:23:13.499808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-289a516c-0e1a-42a5-8ccd-d186cbd79fe2 req-58691ae4-c2a9-4935-9d8c-fb4fb4dcce03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031797 Sep 09 23:23:13.500390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 150/277] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:23:13.533164 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-75152145-a8ee-4b24-87f0-7ae67599e584 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:13.541530 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-75152145-a8ee-4b24-87f0-7ae67599e584 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1473 microversion: 2.1 time: 0.098150 Sep 09 23:23:13.542205 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 128/278] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:13 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1473 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:13.744616 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-283686b0-1703-41a8-bf9b-e18b8f8bbf86 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:13.745311 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-283686b0-1703-41a8-bf9b-e18b8f8bbf86 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:13.751542 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-283686b0-1703-41a8-bf9b-e18b8f8bbf86 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:13.752016 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-283686b0-1703-41a8-bf9b-e18b8f8bbf86 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:13.753100 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-283686b0-1703-41a8-bf9b-e18b8f8bbf86 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:13.753812 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-283686b0-1703-41a8-bf9b-e18b8f8bbf86 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:13.754264 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-283686b0-1703-41a8-bf9b-e18b8f8bbf86 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:13.754744 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-283686b0-1703-41a8-bf9b-e18b8f8bbf86 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:13.807458 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0d6c215a-60c1-4d27-81a7-16c1d4a2deea tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:13.808089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0d6c215a-60c1-4d27-81a7-16c1d4a2deea tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:13.815831 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0d6c215a-60c1-4d27-81a7-16c1d4a2deea tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:13.816443 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0d6c215a-60c1-4d27-81a7-16c1d4a2deea tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:13.817076 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0d6c215a-60c1-4d27-81a7-16c1d4a2deea tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:13.817867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0d6c215a-60c1-4d27-81a7-16c1d4a2deea tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:13.818543 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0d6c215a-60c1-4d27-81a7-16c1d4a2deea tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:13.819130 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0d6c215a-60c1-4d27-81a7-16c1d4a2deea tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:13.829057 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-283686b0-1703-41a8-bf9b-e18b8f8bbf86 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:13.838197 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-283686b0-1703-41a8-bf9b-e18b8f8bbf86 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1462 microversion: 2.1 time: 0.097795 Sep 09 23:23:13.839201 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 151/279] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:13 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1462 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:13.933832 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0d6c215a-60c1-4d27-81a7-16c1d4a2deea tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:13.944731 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0d6c215a-60c1-4d27-81a7-16c1d4a2deea tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1304 microversion: 2.1 time: 0.141668 Sep 09 23:23:13.946185 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 129/280] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:13 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:14.292931 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-6f304490-ca03-413f-9447-04d8045498ff tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:14.292931 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-6f304490-ca03-413f-9447-04d8045498ff tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:14.300634 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6f304490-ca03-413f-9447-04d8045498ff tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:14.301139 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6f304490-ca03-413f-9447-04d8045498ff tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:14.301565 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6f304490-ca03-413f-9447-04d8045498ff tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:14.302261 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6f304490-ca03-413f-9447-04d8045498ff tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:14.302751 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6f304490-ca03-413f-9447-04d8045498ff tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:14.303170 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6f304490-ca03-413f-9447-04d8045498ff tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:14.444699 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-6f304490-ca03-413f-9447-04d8045498ff tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:14.453076 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-6f304490-ca03-413f-9447-04d8045498ff tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.165106 Sep 09 23:23:14.453638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 152/281] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:14 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:14.565866 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a98b7897-e4c8-4c5c-bb74-8d7754d63a89 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:14.566519 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a98b7897-e4c8-4c5c-bb74-8d7754d63a89 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:14.568782 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:14.573299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a98b7897-e4c8-4c5c-bb74-8d7754d63a89 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:14.573779 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a98b7897-e4c8-4c5c-bb74-8d7754d63a89 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:14.574224 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a98b7897-e4c8-4c5c-bb74-8d7754d63a89 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:14.574948 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a98b7897-e4c8-4c5c-bb74-8d7754d63a89 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:14.575394 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a98b7897-e4c8-4c5c-bb74-8d7754d63a89 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:14.575815 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a98b7897-e4c8-4c5c-bb74-8d7754d63a89 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:14.608195 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a98b7897-e4c8-4c5c-bb74-8d7754d63a89 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:14.608669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a98b7897-e4c8-4c5c-bb74-8d7754d63a89 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:14.609102 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a98b7897-e4c8-4c5c-bb74-8d7754d63a89 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:14.609552 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-a98b7897-e4c8-4c5c-bb74-8d7754d63a89 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lazy-loading 'fault' on Instance uuid 0083662b-22d2-4477-af67-902c53f634a1 {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:23:14.656533 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a98b7897-e4c8-4c5c-bb74-8d7754d63a89 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:14.665617 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a98b7897-e4c8-4c5c-bb74-8d7754d63a89 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 200 len: 1309 microversion: 2.1 time: 0.104004 Sep 09 23:23:14.666203 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 130/282] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:14 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:14.861940 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-9015bf54-065e-4222-a0cf-329e9a316c52 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:14.863022 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-9015bf54-065e-4222-a0cf-329e9a316c52 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:14.870196 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9015bf54-065e-4222-a0cf-329e9a316c52 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:14.874201 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9015bf54-065e-4222-a0cf-329e9a316c52 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:14.875665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9015bf54-065e-4222-a0cf-329e9a316c52 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:14.879795 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9015bf54-065e-4222-a0cf-329e9a316c52 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:14.880458 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9015bf54-065e-4222-a0cf-329e9a316c52 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:14.881046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9015bf54-065e-4222-a0cf-329e9a316c52 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:14.954846 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9015bf54-065e-4222-a0cf-329e9a316c52 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:14.955447 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9015bf54-065e-4222-a0cf-329e9a316c52 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:14.956111 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9015bf54-065e-4222-a0cf-329e9a316c52 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:14.956569 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-9015bf54-065e-4222-a0cf-329e9a316c52 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lazy-loading 'fault' on Instance uuid 429d85b0-48f0-43c4-91df-43c474018d06 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:23:14.969197 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-f8de0b7d-1ac8-4b2a-8bdb-a7068a127a97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:14.969366 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-f8de0b7d-1ac8-4b2a-8bdb-a7068a127a97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:14.982605 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f8de0b7d-1ac8-4b2a-8bdb-a7068a127a97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:14.983180 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f8de0b7d-1ac8-4b2a-8bdb-a7068a127a97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:14.983622 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f8de0b7d-1ac8-4b2a-8bdb-a7068a127a97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:14.984526 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f8de0b7d-1ac8-4b2a-8bdb-a7068a127a97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:14.985160 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f8de0b7d-1ac8-4b2a-8bdb-a7068a127a97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:14.991068 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f8de0b7d-1ac8-4b2a-8bdb-a7068a127a97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:15.014813 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-9015bf54-065e-4222-a0cf-329e9a316c52 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:15.018955 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:15.027250 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-9015bf54-065e-4222-a0cf-329e9a316c52 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1304 microversion: 2.1 time: 0.169393 Sep 09 23:23:15.027943 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 153/283] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:14 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1304 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:15.265298 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-f8de0b7d-1ac8-4b2a-8bdb-a7068a127a97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:15.273128 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-f8de0b7d-1ac8-4b2a-8bdb-a7068a127a97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1370 microversion: 2.1 time: 0.308812 Sep 09 23:23:15.279544 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 131/284] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:14 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1370 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:15.477691 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-37426509-0bc8-4328-a106-a4cef5f01290 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:15.478933 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-37426509-0bc8-4328-a106-a4cef5f01290 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:15.488371 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-37426509-0bc8-4328-a106-a4cef5f01290 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:15.490570 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-37426509-0bc8-4328-a106-a4cef5f01290 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:15.491007 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-37426509-0bc8-4328-a106-a4cef5f01290 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:15.494141 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-37426509-0bc8-4328-a106-a4cef5f01290 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:15.494823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-37426509-0bc8-4328-a106-a4cef5f01290 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:15.495257 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-37426509-0bc8-4328-a106-a4cef5f01290 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:15.521977 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-26910b61-0d51-4298-a700-76a42cc8dda5 req-5dd0d6e6-0427-4469-ab8e-c97998c239d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429d85b0-48f0-43c4-91df-43c474018d06", "name": "network-vif-deleted", "tag": "e39db3e3-406c-4eda-ab71-1d721a17ed2b"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:15.536579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-26910b61-0d51-4298-a700-76a42cc8dda5 req-5dd0d6e6-0427-4469-ab8e-c97998c239d2 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:15.537321 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-26910b61-0d51-4298-a700-76a42cc8dda5 req-5dd0d6e6-0427-4469-ab8e-c97998c239d2 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:15.537976 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-26910b61-0d51-4298-a700-76a42cc8dda5 req-5dd0d6e6-0427-4469-ab8e-c97998c239d2 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:15.556359 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-26910b61-0d51-4298-a700-76a42cc8dda5 req-5dd0d6e6-0427-4469-ab8e-c97998c239d2 service nova] Creating event network-vif-deleted:e39db3e3-406c-4eda-ab71-1d721a17ed2b for instance 429d85b0-48f0-43c4-91df-43c474018d06 on hv-cinder-85032 Sep 09 23:23:15.561766 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-26910b61-0d51-4298-a700-76a42cc8dda5 req-5dd0d6e6-0427-4469-ab8e-c97998c239d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044711 Sep 09 23:23:15.562752 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 132/285] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:23:15.642489 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-37426509-0bc8-4328-a106-a4cef5f01290 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:15.651369 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-37426509-0bc8-4328-a106-a4cef5f01290 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.177556 Sep 09 23:23:15.651947 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 154/286] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:15 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:15.689626 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-24390f86-03fb-4497-9a5e-7a25fb48b5b4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:15.691363 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-24390f86-03fb-4497-9a5e-7a25fb48b5b4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: 0083662b-22d2-4477-af67-902c53f634a1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:15.697750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-24390f86-03fb-4497-9a5e-7a25fb48b5b4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:15.698245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-24390f86-03fb-4497-9a5e-7a25fb48b5b4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:15.698711 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-24390f86-03fb-4497-9a5e-7a25fb48b5b4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:15.699407 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-24390f86-03fb-4497-9a5e-7a25fb48b5b4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:15.699863 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-24390f86-03fb-4497-9a5e-7a25fb48b5b4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:15.700294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-24390f86-03fb-4497-9a5e-7a25fb48b5b4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:15.714019 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-24390f86-03fb-4497-9a5e-7a25fb48b5b4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] HTTP exception thrown: Instance 0083662b-22d2-4477-af67-902c53f634a1 could not be found. Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-24390f86-03fb-4497-9a5e-7a25fb48b5b4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Request method failure captured: Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 HTTP/1.1 Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8qNtAt_LXpWwBALmeZAEkpflOHx2rr5GkME6RcMUK1AmOJNB7cMxjA4SvO1BgyQgxYHU9CJ30V-c999KbMDhlC1upRVFudEpke59scVA4FV2ScHZfJMLd2HAYi0NUlaq8ir_EC7_TUw5JQy6u8xphatiXds16BOgb0gRNN6StBHE1U Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: c31116d92493460793d41ba2a6a166e0 Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1875035980 Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:23:15.718741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:23:15.720228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c31116d92493460793d41ba2a6a166e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c31116d92493460793d41ba2a6a166e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c31116d92493460793d41ba2a6a166e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c31116d92493460793d41ba2a6a166e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:23:15.720228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-VolumesSnapshotTestJSON-1875035980 Sep 09 23:23:15.720228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: c31116d92493460793d41ba2a6a166e0 Sep 09 23:23:15.720228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1875035980 Sep 09 23:23:15.720228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-VolumesSnapshotTestJSON-1875035980-project Sep 09 23:23:15.720228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:23:15.720228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:23:15.720228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 72467431e40c491cad192b06be494175 Sep 09 23:23:15.720228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-VolumesSnapshotTestJSON-1875035980-project Sep 09 23:23:15.720228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:23:15.720228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 0083662b-22d2-4477-af67-902c53f634a1 could not be found. Sep 09 23:23:15.720228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '0083662b-22d2-4477-af67-902c53f634a1'} Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0083662b-22d2-4477-af67-902c53f634a1 could not be found. Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:23:15.721717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0083662b-22d2-4477-af67-902c53f634a1 could not be found. Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0083662b-22d2-4477-af67-902c53f634a1 could not be found. Sep 09 23:23:15.722927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:23:15.723872 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-24390f86-03fb-4497-9a5e-7a25fb48b5b4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Returning 404 to user: Instance 0083662b-22d2-4477-af67-902c53f634a1 could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:23:15.723872 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-24390f86-03fb-4497-9a5e-7a25fb48b5b4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1" status: 404 len: 111 microversion: 2.1 time: 0.032272 Sep 09 23:23:15.723872 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 133/287] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:15 2022] GET /compute/v2.1/servers/0083662b-22d2-4477-af67-902c53f634a1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:23:16.091635 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-2e617b4b-fcbb-48f9-b73d-04e99c0a9618 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:16.093074 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-2e617b4b-fcbb-48f9-b73d-04e99c0a9618 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:16.099918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2e617b4b-fcbb-48f9-b73d-04e99c0a9618 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:16.100538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2e617b4b-fcbb-48f9-b73d-04e99c0a9618 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:16.100840 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2e617b4b-fcbb-48f9-b73d-04e99c0a9618 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:16.101610 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2e617b4b-fcbb-48f9-b73d-04e99c0a9618 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:16.102071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2e617b4b-fcbb-48f9-b73d-04e99c0a9618 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:16.102532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2e617b4b-fcbb-48f9-b73d-04e99c0a9618 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:16.134831 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2e617b4b-fcbb-48f9-b73d-04e99c0a9618 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:16.135318 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2e617b4b-fcbb-48f9-b73d-04e99c0a9618 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:16.135759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2e617b4b-fcbb-48f9-b73d-04e99c0a9618 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:16.136205 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-2e617b4b-fcbb-48f9-b73d-04e99c0a9618 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lazy-loading 'fault' on Instance uuid 429d85b0-48f0-43c4-91df-43c474018d06 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:23:16.177989 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-2e617b4b-fcbb-48f9-b73d-04e99c0a9618 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:16.186070 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-2e617b4b-fcbb-48f9-b73d-04e99c0a9618 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1304 microversion: 2.1 time: 0.098772 Sep 09 23:23:16.186651 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 155/288] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:16 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:16.296138 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-2e8d2cf3-1cec-448e-a930-607ad98d4ae7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:16.296672 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-2e8d2cf3-1cec-448e-a930-607ad98d4ae7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:16.302752 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2e8d2cf3-1cec-448e-a930-607ad98d4ae7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:16.303228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2e8d2cf3-1cec-448e-a930-607ad98d4ae7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:16.303657 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2e8d2cf3-1cec-448e-a930-607ad98d4ae7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:16.304334 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2e8d2cf3-1cec-448e-a930-607ad98d4ae7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:16.304788 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2e8d2cf3-1cec-448e-a930-607ad98d4ae7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:16.305206 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2e8d2cf3-1cec-448e-a930-607ad98d4ae7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:16.435258 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-2e8d2cf3-1cec-448e-a930-607ad98d4ae7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:16.443617 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-2e8d2cf3-1cec-448e-a930-607ad98d4ae7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1370 microversion: 2.1 time: 0.151379 Sep 09 23:23:16.444185 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 134/289] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:16 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:16.675003 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-2413e107-ea77-47ec-92c0-83e901b160b8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:16.675607 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-2413e107-ea77-47ec-92c0-83e901b160b8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:16.681980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2413e107-ea77-47ec-92c0-83e901b160b8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:16.682501 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2413e107-ea77-47ec-92c0-83e901b160b8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:16.682941 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2413e107-ea77-47ec-92c0-83e901b160b8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:16.683789 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2413e107-ea77-47ec-92c0-83e901b160b8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:16.684088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2413e107-ea77-47ec-92c0-83e901b160b8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:16.684512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2413e107-ea77-47ec-92c0-83e901b160b8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:16.810853 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-2413e107-ea77-47ec-92c0-83e901b160b8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:16.819327 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-2413e107-ea77-47ec-92c0-83e901b160b8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.148187 Sep 09 23:23:16.819887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 156/290] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:16 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:17.209946 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8ea90fa3-ad6a-4b4a-8b87-1c68c3af75a5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:17.210586 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8ea90fa3-ad6a-4b4a-8b87-1c68c3af75a5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:17.217001 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ea90fa3-ad6a-4b4a-8b87-1c68c3af75a5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:17.217485 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ea90fa3-ad6a-4b4a-8b87-1c68c3af75a5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:17.217919 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ea90fa3-ad6a-4b4a-8b87-1c68c3af75a5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:17.218664 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ea90fa3-ad6a-4b4a-8b87-1c68c3af75a5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:17.219088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ea90fa3-ad6a-4b4a-8b87-1c68c3af75a5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:17.219508 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ea90fa3-ad6a-4b4a-8b87-1c68c3af75a5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:17.251965 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ea90fa3-ad6a-4b4a-8b87-1c68c3af75a5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:17.253377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ea90fa3-ad6a-4b4a-8b87-1c68c3af75a5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:17.253821 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ea90fa3-ad6a-4b4a-8b87-1c68c3af75a5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:17.254268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-8ea90fa3-ad6a-4b4a-8b87-1c68c3af75a5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lazy-loading 'fault' on Instance uuid 429d85b0-48f0-43c4-91df-43c474018d06 {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:23:17.296456 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8ea90fa3-ad6a-4b4a-8b87-1c68c3af75a5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:17.304918 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8ea90fa3-ad6a-4b4a-8b87-1c68c3af75a5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1304 microversion: 2.1 time: 0.099817 Sep 09 23:23:17.305437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 135/291] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:17 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:17.467331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ff68a121-9201-4bf8-8e9f-fa367b17f05c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:17.467936 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ff68a121-9201-4bf8-8e9f-fa367b17f05c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:17.474776 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff68a121-9201-4bf8-8e9f-fa367b17f05c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:17.475258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff68a121-9201-4bf8-8e9f-fa367b17f05c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:17.475714 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff68a121-9201-4bf8-8e9f-fa367b17f05c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:17.476413 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff68a121-9201-4bf8-8e9f-fa367b17f05c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:17.476865 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff68a121-9201-4bf8-8e9f-fa367b17f05c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:17.477308 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff68a121-9201-4bf8-8e9f-fa367b17f05c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:17.588932 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-48747a45-2977-40fa-8f67-82d2de834d31 req-23c5f635-9d4e-458d-9997-d9df19d2fb1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff", "tag": "4ed06e43-5924-4dd9-b9a7-e0cbcd55d744"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:17.599270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-48747a45-2977-40fa-8f67-82d2de834d31 req-23c5f635-9d4e-458d-9997-d9df19d2fb1f service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:17.599753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-48747a45-2977-40fa-8f67-82d2de834d31 req-23c5f635-9d4e-458d-9997-d9df19d2fb1f service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:17.600189 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-48747a45-2977-40fa-8f67-82d2de834d31 req-23c5f635-9d4e-458d-9997-d9df19d2fb1f service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:17.607140 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ff68a121-9201-4bf8-8e9f-fa367b17f05c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:17.612002 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-48747a45-2977-40fa-8f67-82d2de834d31 req-23c5f635-9d4e-458d-9997-d9df19d2fb1f service nova] Creating event network-changed:4ed06e43-5924-4dd9-b9a7-e0cbcd55d744 for instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff on hv-cinder-85032 Sep 09 23:23:17.614797 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ff68a121-9201-4bf8-8e9f-fa367b17f05c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1370 microversion: 2.1 time: 0.151389 Sep 09 23:23:17.616463 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 157/292] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:17 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:17.617399 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-48747a45-2977-40fa-8f67-82d2de834d31 req-23c5f635-9d4e-458d-9997-d9df19d2fb1f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032072 Sep 09 23:23:17.617990 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 136/293] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:23:17.843292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8f7c363b-4b8a-4c3c-972d-54a76ff55994 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:17.843896 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8f7c363b-4b8a-4c3c-972d-54a76ff55994 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:17.850653 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f7c363b-4b8a-4c3c-972d-54a76ff55994 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:17.851135 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f7c363b-4b8a-4c3c-972d-54a76ff55994 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:17.851566 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f7c363b-4b8a-4c3c-972d-54a76ff55994 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:17.852248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f7c363b-4b8a-4c3c-972d-54a76ff55994 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:17.852698 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f7c363b-4b8a-4c3c-972d-54a76ff55994 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:17.853121 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8f7c363b-4b8a-4c3c-972d-54a76ff55994 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:17.971448 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=4 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:17.978876 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8f7c363b-4b8a-4c3c-972d-54a76ff55994 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:17.987328 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8f7c363b-4b8a-4c3c-972d-54a76ff55994 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.147871 Sep 09 23:23:17.988359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 158/294] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:17 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:18.328742 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-d4211c56-dd54-4b6e-ac8a-bf24f8804fba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:18.329443 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-d4211c56-dd54-4b6e-ac8a-bf24f8804fba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:18.335751 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4211c56-dd54-4b6e-ac8a-bf24f8804fba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:18.336237 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4211c56-dd54-4b6e-ac8a-bf24f8804fba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:18.336678 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4211c56-dd54-4b6e-ac8a-bf24f8804fba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:18.337371 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4211c56-dd54-4b6e-ac8a-bf24f8804fba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:18.337824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4211c56-dd54-4b6e-ac8a-bf24f8804fba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:18.338249 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4211c56-dd54-4b6e-ac8a-bf24f8804fba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:18.369493 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4211c56-dd54-4b6e-ac8a-bf24f8804fba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:18.369899 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4211c56-dd54-4b6e-ac8a-bf24f8804fba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:18.370354 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4211c56-dd54-4b6e-ac8a-bf24f8804fba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:18.370814 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-d4211c56-dd54-4b6e-ac8a-bf24f8804fba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lazy-loading 'fault' on Instance uuid 429d85b0-48f0-43c4-91df-43c474018d06 {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:23:18.415627 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d4211c56-dd54-4b6e-ac8a-bf24f8804fba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:18.425075 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-d4211c56-dd54-4b6e-ac8a-bf24f8804fba tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1304 microversion: 2.1 time: 0.101213 Sep 09 23:23:18.425648 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 137/295] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:18 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:18.640167 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3586cf54-7bfb-4b93-915f-741268a1c561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:18.640708 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3586cf54-7bfb-4b93-915f-741268a1c561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:18.647924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3586cf54-7bfb-4b93-915f-741268a1c561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:18.648416 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3586cf54-7bfb-4b93-915f-741268a1c561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:18.648853 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3586cf54-7bfb-4b93-915f-741268a1c561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:18.649554 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3586cf54-7bfb-4b93-915f-741268a1c561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:18.650014 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3586cf54-7bfb-4b93-915f-741268a1c561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:18.650465 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3586cf54-7bfb-4b93-915f-741268a1c561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:18.789949 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3586cf54-7bfb-4b93-915f-741268a1c561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:18.798232 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3586cf54-7bfb-4b93-915f-741268a1c561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1370 microversion: 2.1 time: 0.165059 Sep 09 23:23:18.798882 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 159/296] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:18 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:19.016012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-bc1eae17-5640-4aa0-821a-a80453cfe237 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:19.016568 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-bc1eae17-5640-4aa0-821a-a80453cfe237 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:19.022762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bc1eae17-5640-4aa0-821a-a80453cfe237 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:19.023241 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bc1eae17-5640-4aa0-821a-a80453cfe237 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:19.023674 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bc1eae17-5640-4aa0-821a-a80453cfe237 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:19.024361 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bc1eae17-5640-4aa0-821a-a80453cfe237 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:19.024811 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bc1eae17-5640-4aa0-821a-a80453cfe237 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:19.025232 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bc1eae17-5640-4aa0-821a-a80453cfe237 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:19.155971 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bc1eae17-5640-4aa0-821a-a80453cfe237 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:19.165528 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-bc1eae17-5640-4aa0-821a-a80453cfe237 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.153470 Sep 09 23:23:19.166136 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 138/297] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:19 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:19.448893 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-224a2f69-ca02-43bc-87cf-4ff6490dfb29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:19.449538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-224a2f69-ca02-43bc-87cf-4ff6490dfb29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:19.456298 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-224a2f69-ca02-43bc-87cf-4ff6490dfb29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:19.456794 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-224a2f69-ca02-43bc-87cf-4ff6490dfb29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:19.457255 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-224a2f69-ca02-43bc-87cf-4ff6490dfb29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:19.457953 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-224a2f69-ca02-43bc-87cf-4ff6490dfb29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:19.458452 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-224a2f69-ca02-43bc-87cf-4ff6490dfb29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:19.458882 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-224a2f69-ca02-43bc-87cf-4ff6490dfb29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:19.490932 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-224a2f69-ca02-43bc-87cf-4ff6490dfb29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:19.491418 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-224a2f69-ca02-43bc-87cf-4ff6490dfb29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:19.491861 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-224a2f69-ca02-43bc-87cf-4ff6490dfb29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:19.492304 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-224a2f69-ca02-43bc-87cf-4ff6490dfb29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lazy-loading 'fault' on Instance uuid 429d85b0-48f0-43c4-91df-43c474018d06 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:23:19.530943 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-224a2f69-ca02-43bc-87cf-4ff6490dfb29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:19.539187 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-224a2f69-ca02-43bc-87cf-4ff6490dfb29 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 200 len: 1304 microversion: 2.1 time: 0.094154 Sep 09 23:23:19.539755 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 160/298] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:19 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:19.821229 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-f491beda-af7c-4bc8-af1f-ff4b3673ad96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:19.821940 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-f491beda-af7c-4bc8-af1f-ff4b3673ad96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:19.829038 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f491beda-af7c-4bc8-af1f-ff4b3673ad96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:19.835710 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f491beda-af7c-4bc8-af1f-ff4b3673ad96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:19.835710 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f491beda-af7c-4bc8-af1f-ff4b3673ad96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:19.835710 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f491beda-af7c-4bc8-af1f-ff4b3673ad96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:19.835710 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f491beda-af7c-4bc8-af1f-ff4b3673ad96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:19.836210 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f491beda-af7c-4bc8-af1f-ff4b3673ad96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:19.971605 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-f491beda-af7c-4bc8-af1f-ff4b3673ad96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:19.979257 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-f491beda-af7c-4bc8-af1f-ff4b3673ad96 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1370 microversion: 2.1 time: 0.161972 Sep 09 23:23:19.979766 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 139/299] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:19 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:20.190873 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ab66a1f8-0d8f-457e-bb97-fed1934a8033 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:20.191502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ab66a1f8-0d8f-457e-bb97-fed1934a8033 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:20.197478 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab66a1f8-0d8f-457e-bb97-fed1934a8033 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:20.197958 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab66a1f8-0d8f-457e-bb97-fed1934a8033 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:20.198427 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab66a1f8-0d8f-457e-bb97-fed1934a8033 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:20.199112 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab66a1f8-0d8f-457e-bb97-fed1934a8033 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:20.199564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab66a1f8-0d8f-457e-bb97-fed1934a8033 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:20.199986 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab66a1f8-0d8f-457e-bb97-fed1934a8033 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:20.330531 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ab66a1f8-0d8f-457e-bb97-fed1934a8033 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:20.338925 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ab66a1f8-0d8f-457e-bb97-fed1934a8033 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.152560 Sep 09 23:23:20.339475 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 161/300] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:20 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:20.564210 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9396dc33-7fee-4465-9209-ccc0fb9e4d5c tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:20.564210 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9396dc33-7fee-4465-9209-ccc0fb9e4d5c tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 429d85b0-48f0-43c4-91df-43c474018d06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:20.568822 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9396dc33-7fee-4465-9209-ccc0fb9e4d5c tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:20.569297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9396dc33-7fee-4465-9209-ccc0fb9e4d5c tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:20.569727 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9396dc33-7fee-4465-9209-ccc0fb9e4d5c tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:20.570435 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9396dc33-7fee-4465-9209-ccc0fb9e4d5c tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:20.570887 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9396dc33-7fee-4465-9209-ccc0fb9e4d5c tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:20.571309 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9396dc33-7fee-4465-9209-ccc0fb9e4d5c tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:20.584473 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-9396dc33-7fee-4465-9209-ccc0fb9e4d5c tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] HTTP exception thrown: Instance 429d85b0-48f0-43c4-91df-43c474018d06 could not be found. Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9396dc33-7fee-4465-9209-ccc0fb9e4d5c tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Request method failure captured: Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 HTTP/1.1 Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8rFYecm37vueSJm7cEdIl6T5C03GLdyAF7MQNgBusH6PGV8mLt9yK0tDBmI_SMeuTvg1Iy9LlyKQc_vN3I7r-nauEGp49p3gvJqMTtZhwmVQYX8gpEGgHi-hRSv8RIgXQHW3Nf6tNgg7EltW9Mj17SFYdXhE4RVjNWoWdxKkoaxWCs Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 44a4181be7e6404487bd7eddca1f6d8c Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-VolumesActionsTest-1115233279 Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:23:20.586104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:23:20.587693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/44a4181be7e6404487bd7eddca1f6d8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/44a4181be7e6404487bd7eddca1f6d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/44a4181be7e6404487bd7eddca1f6d8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_44a4181be7e6404487bd7eddca1f6d8c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:23:20.587693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-VolumesActionsTest-1115233279 Sep 09 23:23:20.587693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 44a4181be7e6404487bd7eddca1f6d8c Sep 09 23:23:20.587693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-VolumesActionsTest-1115233279 Sep 09 23:23:20.587693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-VolumesActionsTest-1115233279-project Sep 09 23:23:20.587693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:23:20.587693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:23:20.587693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 75c27b297062483598cf8ff5185e2f2a Sep 09 23:23:20.587693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-VolumesActionsTest-1115233279-project Sep 09 23:23:20.587693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:23:20.587693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 429d85b0-48f0-43c4-91df-43c474018d06 could not be found. Sep 09 23:23:20.587693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '429d85b0-48f0-43c4-91df-43c474018d06'} Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 429d85b0-48f0-43c4-91df-43c474018d06 could not be found. Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:23:20.588572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 429d85b0-48f0-43c4-91df-43c474018d06 could not be found. Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 429d85b0-48f0-43c4-91df-43c474018d06 could not be found. Sep 09 23:23:20.589923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:23:20.591149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9396dc33-7fee-4465-9209-ccc0fb9e4d5c tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Returning 404 to user: Instance 429d85b0-48f0-43c4-91df-43c474018d06 could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:23:20.591149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9396dc33-7fee-4465-9209-ccc0fb9e4d5c tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06" status: 404 len: 111 microversion: 2.1 time: 0.029874 Sep 09 23:23:20.591149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 140/301] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:20 2022] GET /compute/v2.1/servers/429d85b0-48f0-43c4-91df-43c474018d06 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:23:20.688096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2014753435", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "networks": [{"uuid": "12da80aa-e764-40ac-93e6-d72eb4e5ad16"}]}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:20.697553 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:20.744301 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.network.neutron [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] validate_networks() for [('12da80aa-e764-40ac-93e6-d72eb4e5ad16', None, None, None, None, None)] {{(pid=121059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:23:21.001498 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-88a85ca5-661f-40ef-aff3-6e3c55c2c410 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:21.002647 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-88a85ca5-661f-40ef-aff3-6e3c55c2c410 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:21.009169 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-88a85ca5-661f-40ef-aff3-6e3c55c2c410 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:21.009652 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-88a85ca5-661f-40ef-aff3-6e3c55c2c410 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:21.010089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-88a85ca5-661f-40ef-aff3-6e3c55c2c410 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:21.010809 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-88a85ca5-661f-40ef-aff3-6e3c55c2c410 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:21.011270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-88a85ca5-661f-40ef-aff3-6e3c55c2c410 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:21.011692 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-88a85ca5-661f-40ef-aff3-6e3c55c2c410 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:21.097142 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Flavor limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:23:21.097591 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Image limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:23:21.098071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Flavor pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:23:21.098518 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Image pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:23:21.099039 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:23:21.106646 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=2 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:21.108885 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:21.109372 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:21.109808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:21.110919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:21.112172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:21.112607 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:21.131956 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Getting quotas for project 44a4181be7e6404487bd7eddca1f6d8c. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:23:21.136604 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Getting quotas for user 75c27b297062483598cf8ff5185e2f2a and project 44a4181be7e6404487bd7eddca1f6d8c. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:23:21.148692 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Going to run 1 instances... {{(pid=121059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:23:21.151138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:23:21.305456 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a2a57791-1f90-4540-9730-25d9bb0ae1e4 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621242 Sep 09 23:23:21.306276 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 162/302] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:23:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:23:21.317883 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-afab9863-cc5a-4d0d-8cd8-f7b097190b5d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:21.318531 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-afab9863-cc5a-4d0d-8cd8-f7b097190b5d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:21.353102 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=8 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:21.361114 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-88a85ca5-661f-40ef-aff3-6e3c55c2c410 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:21.369741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-88a85ca5-661f-40ef-aff3-6e3c55c2c410 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1370 microversion: 2.1 time: 0.372061 Sep 09 23:23:21.370359 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 141/303] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:20 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1370 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:21.375236 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-113e612a-71f7-4c4a-aaa5-5e7b3d3b6e10 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:21.385763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-113e612a-71f7-4c4a-aaa5-5e7b3d3b6e10 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:21.385763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-113e612a-71f7-4c4a-aaa5-5e7b3d3b6e10 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:21.385763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-113e612a-71f7-4c4a-aaa5-5e7b3d3b6e10 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:21.385763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-113e612a-71f7-4c4a-aaa5-5e7b3d3b6e10 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:21.386159 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-113e612a-71f7-4c4a-aaa5-5e7b3d3b6e10 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:21.386159 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-113e612a-71f7-4c4a-aaa5-5e7b3d3b6e10 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:21.386159 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-113e612a-71f7-4c4a-aaa5-5e7b3d3b6e10 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:21.416879 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-afab9863-cc5a-4d0d-8cd8-f7b097190b5d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:21.425344 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-afab9863-cc5a-4d0d-8cd8-f7b097190b5d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1214 microversion: 2.1 time: 0.111780 Sep 09 23:23:21.434218 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 163/304] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:21 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:21.522207 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-113e612a-71f7-4c4a-aaa5-5e7b3d3b6e10 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:21.530431 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-113e612a-71f7-4c4a-aaa5-5e7b3d3b6e10 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.158911 Sep 09 23:23:21.531007 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 142/305] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:21 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:22.393726 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ed0b4868-2437-4340-8376-c9516c56ff79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:22.397872 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ed0b4868-2437-4340-8376-c9516c56ff79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:22.401114 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ed0b4868-2437-4340-8376-c9516c56ff79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:22.401584 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ed0b4868-2437-4340-8376-c9516c56ff79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:22.402089 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ed0b4868-2437-4340-8376-c9516c56ff79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:22.402900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ed0b4868-2437-4340-8376-c9516c56ff79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:22.403486 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ed0b4868-2437-4340-8376-c9516c56ff79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:22.403910 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ed0b4868-2437-4340-8376-c9516c56ff79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:22.448550 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5cf1fcff-ae9a-47e3-853d-6c7399107634 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:22.449186 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5cf1fcff-ae9a-47e3-853d-6c7399107634 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:22.455856 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5cf1fcff-ae9a-47e3-853d-6c7399107634 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:22.456495 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5cf1fcff-ae9a-47e3-853d-6c7399107634 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:22.457085 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5cf1fcff-ae9a-47e3-853d-6c7399107634 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:22.458825 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5cf1fcff-ae9a-47e3-853d-6c7399107634 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:22.459489 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5cf1fcff-ae9a-47e3-853d-6c7399107634 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:22.460146 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5cf1fcff-ae9a-47e3-853d-6c7399107634 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:22.542054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5cf1fcff-ae9a-47e3-853d-6c7399107634 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:22.550964 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5cf1fcff-ae9a-47e3-853d-6c7399107634 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1218 microversion: 2.1 time: 0.106621 Sep 09 23:23:22.551849 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 143/306] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:22 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:22.557214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-00432b15-36c1-4039-a4ec-8a725fb5b9bb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:22.557882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-00432b15-36c1-4039-a4ec-8a725fb5b9bb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:22.561859 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ed0b4868-2437-4340-8376-c9516c56ff79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:22.563726 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-00432b15-36c1-4039-a4ec-8a725fb5b9bb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:22.577292 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-00432b15-36c1-4039-a4ec-8a725fb5b9bb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:22.577292 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-00432b15-36c1-4039-a4ec-8a725fb5b9bb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:22.577292 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-00432b15-36c1-4039-a4ec-8a725fb5b9bb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:22.577292 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-00432b15-36c1-4039-a4ec-8a725fb5b9bb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:22.577681 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-00432b15-36c1-4039-a4ec-8a725fb5b9bb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:22.577771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ed0b4868-2437-4340-8376-c9516c56ff79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1370 microversion: 2.1 time: 0.180979 Sep 09 23:23:22.577771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 164/307] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:22 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:22.702822 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-00432b15-36c1-4039-a4ec-8a725fb5b9bb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:22.723386 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-00432b15-36c1-4039-a4ec-8a725fb5b9bb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.164777 Sep 09 23:23:22.723386 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 144/308] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:22 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:23.575004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8ecbaaaf-7757-48f2-84ae-ec080ee34349 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:23.575654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8ecbaaaf-7757-48f2-84ae-ec080ee34349 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:23.585007 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8ecbaaaf-7757-48f2-84ae-ec080ee34349 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:23.585007 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8ecbaaaf-7757-48f2-84ae-ec080ee34349 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:23.585007 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8ecbaaaf-7757-48f2-84ae-ec080ee34349 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:23.585007 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8ecbaaaf-7757-48f2-84ae-ec080ee34349 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:23.585379 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8ecbaaaf-7757-48f2-84ae-ec080ee34349 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:23.585379 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8ecbaaaf-7757-48f2-84ae-ec080ee34349 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:23.599836 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c766df41-2b03-4eb8-8b73-d932f5c8a021 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:23.600566 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c766df41-2b03-4eb8-8b73-d932f5c8a021 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:23.607660 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c766df41-2b03-4eb8-8b73-d932f5c8a021 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:23.613889 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c766df41-2b03-4eb8-8b73-d932f5c8a021 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:23.613889 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c766df41-2b03-4eb8-8b73-d932f5c8a021 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:23.613889 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c766df41-2b03-4eb8-8b73-d932f5c8a021 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:23.613889 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c766df41-2b03-4eb8-8b73-d932f5c8a021 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:23.614442 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c766df41-2b03-4eb8-8b73-d932f5c8a021 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:23.660836 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8ecbaaaf-7757-48f2-84ae-ec080ee34349 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:23.684683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8ecbaaaf-7757-48f2-84ae-ec080ee34349 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1210 microversion: 2.1 time: 0.113573 Sep 09 23:23:23.685260 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 165/309] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:23 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1210 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:23.744936 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d9cf4fef-3565-432a-b7fc-0cc11fd2a42d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:23.751773 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d9cf4fef-3565-432a-b7fc-0cc11fd2a42d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:23.752579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d9cf4fef-3565-432a-b7fc-0cc11fd2a42d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:23.753138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d9cf4fef-3565-432a-b7fc-0cc11fd2a42d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:23.753768 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d9cf4fef-3565-432a-b7fc-0cc11fd2a42d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:23.754781 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d9cf4fef-3565-432a-b7fc-0cc11fd2a42d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:23.755256 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d9cf4fef-3565-432a-b7fc-0cc11fd2a42d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:23.755893 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d9cf4fef-3565-432a-b7fc-0cc11fd2a42d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:23.766653 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c766df41-2b03-4eb8-8b73-d932f5c8a021 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:23.775742 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c766df41-2b03-4eb8-8b73-d932f5c8a021 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1370 microversion: 2.1 time: 0.179724 Sep 09 23:23:23.776464 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 145/310] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:23 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:23.897635 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d9cf4fef-3565-432a-b7fc-0cc11fd2a42d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:23.907073 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d9cf4fef-3565-432a-b7fc-0cc11fd2a42d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.165952 Sep 09 23:23:23.907750 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 166/311] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:23 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:24.708944 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-85bc66eb-5658-4629-935f-a6195f5572b5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:24.709515 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-85bc66eb-5658-4629-935f-a6195f5572b5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:24.715898 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-85bc66eb-5658-4629-935f-a6195f5572b5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:24.716381 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-85bc66eb-5658-4629-935f-a6195f5572b5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:24.716817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-85bc66eb-5658-4629-935f-a6195f5572b5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:24.717532 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-85bc66eb-5658-4629-935f-a6195f5572b5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:24.717969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-85bc66eb-5658-4629-935f-a6195f5572b5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:24.718428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-85bc66eb-5658-4629-935f-a6195f5572b5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:24.733512 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=100 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:24.779807 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-85bc66eb-5658-4629-935f-a6195f5572b5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:24.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-85bc66eb-5658-4629-935f-a6195f5572b5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1274 microversion: 2.1 time: 0.083244 Sep 09 23:23:24.788157 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 146/312] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:24 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:24.799645 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1eca3bf8-5e72-44da-8a0d-a4d846019048 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:24.800903 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1eca3bf8-5e72-44da-8a0d-a4d846019048 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:24.807406 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1eca3bf8-5e72-44da-8a0d-a4d846019048 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:24.807915 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1eca3bf8-5e72-44da-8a0d-a4d846019048 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:24.808347 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1eca3bf8-5e72-44da-8a0d-a4d846019048 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:24.809034 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1eca3bf8-5e72-44da-8a0d-a4d846019048 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:24.809552 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1eca3bf8-5e72-44da-8a0d-a4d846019048 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:24.809971 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1eca3bf8-5e72-44da-8a0d-a4d846019048 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:24.933078 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-eeb4ecc3-a8c6-489c-b98b-8326b9b53c00 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:24.933794 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-eeb4ecc3-a8c6-489c-b98b-8326b9b53c00 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:24.939787 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eeb4ecc3-a8c6-489c-b98b-8326b9b53c00 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:24.940349 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eeb4ecc3-a8c6-489c-b98b-8326b9b53c00 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:24.940861 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eeb4ecc3-a8c6-489c-b98b-8326b9b53c00 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:24.942361 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eeb4ecc3-a8c6-489c-b98b-8326b9b53c00 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:24.943007 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eeb4ecc3-a8c6-489c-b98b-8326b9b53c00 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:24.943442 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eeb4ecc3-a8c6-489c-b98b-8326b9b53c00 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:24.944787 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1eca3bf8-5e72-44da-8a0d-a4d846019048 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:24.952490 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1eca3bf8-5e72-44da-8a0d-a4d846019048 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1370 microversion: 2.1 time: 0.156750 Sep 09 23:23:24.953068 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 167/313] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:24 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:25.077412 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-eeb4ecc3-a8c6-489c-b98b-8326b9b53c00 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:25.086118 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-eeb4ecc3-a8c6-489c-b98b-8326b9b53c00 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.157018 Sep 09 23:23:25.086718 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 147/314] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:24 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:25.810742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-10c6c5ea-58d2-418b-9949-04a6fa8986d1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:25.811274 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-10c6c5ea-58d2-418b-9949-04a6fa8986d1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:25.819048 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-10c6c5ea-58d2-418b-9949-04a6fa8986d1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:25.819531 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-10c6c5ea-58d2-418b-9949-04a6fa8986d1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:25.819962 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-10c6c5ea-58d2-418b-9949-04a6fa8986d1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:25.820727 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-10c6c5ea-58d2-418b-9949-04a6fa8986d1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:25.821109 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-10c6c5ea-58d2-418b-9949-04a6fa8986d1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:25.821535 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-10c6c5ea-58d2-418b-9949-04a6fa8986d1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:25.882334 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-10c6c5ea-58d2-418b-9949-04a6fa8986d1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:25.889953 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-10c6c5ea-58d2-418b-9949-04a6fa8986d1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1274 microversion: 2.1 time: 0.083206 Sep 09 23:23:25.890562 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 168/315] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:25 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:25.975481 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b76b3098-c338-4964-8260-4400287381ac tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:25.976090 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b76b3098-c338-4964-8260-4400287381ac tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:25.982673 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b76b3098-c338-4964-8260-4400287381ac tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:25.983151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b76b3098-c338-4964-8260-4400287381ac tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:25.983583 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b76b3098-c338-4964-8260-4400287381ac tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:25.984267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b76b3098-c338-4964-8260-4400287381ac tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:25.984717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b76b3098-c338-4964-8260-4400287381ac tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:25.985140 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b76b3098-c338-4964-8260-4400287381ac tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:26.111347 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-9589f9ee-753e-4541-a325-68e846de232f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:26.111992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-9589f9ee-753e-4541-a325-68e846de232f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:26.112710 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b76b3098-c338-4964-8260-4400287381ac tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:26.118982 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9589f9ee-753e-4541-a325-68e846de232f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:26.119462 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9589f9ee-753e-4541-a325-68e846de232f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:26.119901 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9589f9ee-753e-4541-a325-68e846de232f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:26.120595 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9589f9ee-753e-4541-a325-68e846de232f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:26.120879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b76b3098-c338-4964-8260-4400287381ac tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1370 microversion: 2.1 time: 0.149890 Sep 09 23:23:26.121052 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9589f9ee-753e-4541-a325-68e846de232f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:26.121480 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9589f9ee-753e-4541-a325-68e846de232f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:26.121937 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 148/316] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:25 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:26.260586 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-9589f9ee-753e-4541-a325-68e846de232f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:26.268938 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-9589f9ee-753e-4541-a325-68e846de232f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.161426 Sep 09 23:23:26.270328 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 169/317] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:26 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:26.914189 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-cbad217e-710c-406b-be80-144af4155324 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:26.914757 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-cbad217e-710c-406b-be80-144af4155324 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:26.920669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cbad217e-710c-406b-be80-144af4155324 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:26.921142 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cbad217e-710c-406b-be80-144af4155324 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:26.921570 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cbad217e-710c-406b-be80-144af4155324 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:26.922245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cbad217e-710c-406b-be80-144af4155324 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:26.922719 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cbad217e-710c-406b-be80-144af4155324 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:26.923137 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cbad217e-710c-406b-be80-144af4155324 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:26.989367 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-cbad217e-710c-406b-be80-144af4155324 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:26.997093 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-cbad217e-710c-406b-be80-144af4155324 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1274 microversion: 2.1 time: 0.087315 Sep 09 23:23:26.997653 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 149/318] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:26 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:27.144409 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-9bdc6a8f-45d8-4592-82fc-72173201ee5c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:27.145022 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-9bdc6a8f-45d8-4592-82fc-72173201ee5c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:27.151784 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9bdc6a8f-45d8-4592-82fc-72173201ee5c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:27.152269 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9bdc6a8f-45d8-4592-82fc-72173201ee5c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:27.152712 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9bdc6a8f-45d8-4592-82fc-72173201ee5c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:27.153403 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9bdc6a8f-45d8-4592-82fc-72173201ee5c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:27.153855 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9bdc6a8f-45d8-4592-82fc-72173201ee5c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:27.154277 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9bdc6a8f-45d8-4592-82fc-72173201ee5c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:27.286711 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-9bdc6a8f-45d8-4592-82fc-72173201ee5c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:27.293635 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-d3fdf10c-ae05-4cd9-9635-72c40d611681 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:27.294589 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-d3fdf10c-ae05-4cd9-9635-72c40d611681 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:27.295216 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-9bdc6a8f-45d8-4592-82fc-72173201ee5c tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1370 microversion: 2.1 time: 0.154720 Sep 09 23:23:27.295901 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 170/319] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:27 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:27.309690 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d3fdf10c-ae05-4cd9-9635-72c40d611681 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:27.318574 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d3fdf10c-ae05-4cd9-9635-72c40d611681 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:27.320997 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d3fdf10c-ae05-4cd9-9635-72c40d611681 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:27.320997 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d3fdf10c-ae05-4cd9-9635-72c40d611681 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:27.320997 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d3fdf10c-ae05-4cd9-9635-72c40d611681 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:27.320997 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d3fdf10c-ae05-4cd9-9635-72c40d611681 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:27.466289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d3fdf10c-ae05-4cd9-9635-72c40d611681 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:27.476705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-d3fdf10c-ae05-4cd9-9635-72c40d611681 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.187148 Sep 09 23:23:27.477907 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 150/320] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:27 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:28.020631 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d6e88bac-57f4-4a39-8e78-fe8310d1c1e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:28.021236 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d6e88bac-57f4-4a39-8e78-fe8310d1c1e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:28.028114 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d6e88bac-57f4-4a39-8e78-fe8310d1c1e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:28.030482 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d6e88bac-57f4-4a39-8e78-fe8310d1c1e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:28.030482 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d6e88bac-57f4-4a39-8e78-fe8310d1c1e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:28.030482 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d6e88bac-57f4-4a39-8e78-fe8310d1c1e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:28.030482 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d6e88bac-57f4-4a39-8e78-fe8310d1c1e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:28.030822 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d6e88bac-57f4-4a39-8e78-fe8310d1c1e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:28.049283 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=100 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:28.161391 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d6e88bac-57f4-4a39-8e78-fe8310d1c1e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:28.169240 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d6e88bac-57f4-4a39-8e78-fe8310d1c1e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1314 microversion: 2.1 time: 0.153168 Sep 09 23:23:28.169810 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 171/321] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:28 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:28.320982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5716d845-c087-49e7-befa-a2815c6db623 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:28.323025 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5716d845-c087-49e7-befa-a2815c6db623 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:28.330985 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5716d845-c087-49e7-befa-a2815c6db623 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:28.331789 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5716d845-c087-49e7-befa-a2815c6db623 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:28.332703 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5716d845-c087-49e7-befa-a2815c6db623 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:28.333613 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5716d845-c087-49e7-befa-a2815c6db623 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:28.334216 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5716d845-c087-49e7-befa-a2815c6db623 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:28.335206 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5716d845-c087-49e7-befa-a2815c6db623 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:28.385449 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2022322136", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "networks": [{"uuid": "b60acfc9-5746-4d6b-bb71-8a6ecb35589e"}]}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:28.458163 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.network.neutron [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] validate_networks() for [('b60acfc9-5746-4d6b-bb71-8a6ecb35589e', None, None, None, None, None)] {{(pid=121059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:23:28.580865 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5716d845-c087-49e7-befa-a2815c6db623 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:28.593311 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5716d845-c087-49e7-befa-a2815c6db623 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1370 microversion: 2.1 time: 0.278151 Sep 09 23:23:28.593983 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 151/322] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:28 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1370 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:28.615760 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-f02e49fb-7c7e-41f2-af83-c6664cf53e66 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:28.616375 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-f02e49fb-7c7e-41f2-af83-c6664cf53e66 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:28.622677 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f02e49fb-7c7e-41f2-af83-c6664cf53e66 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:28.623169 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f02e49fb-7c7e-41f2-af83-c6664cf53e66 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:28.623655 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f02e49fb-7c7e-41f2-af83-c6664cf53e66 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:28.624449 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f02e49fb-7c7e-41f2-af83-c6664cf53e66 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:28.624922 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f02e49fb-7c7e-41f2-af83-c6664cf53e66 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:28.625356 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f02e49fb-7c7e-41f2-af83-c6664cf53e66 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:28.872033 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-f02e49fb-7c7e-41f2-af83-c6664cf53e66 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:28.884282 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-f02e49fb-7c7e-41f2-af83-c6664cf53e66 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1724 microversion: 2.1 time: 0.272992 Sep 09 23:23:28.885519 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 152/323] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:28 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:28.927649 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Flavor limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:23:28.928079 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Image limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:23:28.928552 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Flavor pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:23:28.929808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Image pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:23:28.929808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:23:28.946208 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:28.947085 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:28.947555 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:28.948293 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:28.948946 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:28.949424 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:28.970022 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Getting quotas for project c31116d92493460793d41ba2a6a166e0. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:23:28.974755 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Getting quotas for user 72467431e40c491cad192b06be494175 and project c31116d92493460793d41ba2a6a166e0. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:23:28.989327 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Going to run 1 instances... {{(pid=121059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:23:28.991595 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:23:29.130943 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-9bfe5065-2db7-46af-bea6-8789c209889f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749153 Sep 09 23:23:29.131826 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 172/324] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:23:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 23:23:29.142989 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-64ad976a-99e1-4454-a520-18f1b832438a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:29.143853 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-64ad976a-99e1-4454-a520-18f1b832438a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:29.148456 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-7f4ab9c2-9fd1-42f0-9233-6cdc3755cd68 req-27a4e2bc-42aa-4a52-af23-723bfd00fa2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42037737-e99b-49b9-9af0-c3aa68cfc09f", "tag": "d195d625-0e4f-449a-85ea-c38c152c8b70"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:29.163019 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-7f4ab9c2-9fd1-42f0-9233-6cdc3755cd68 req-27a4e2bc-42aa-4a52-af23-723bfd00fa2e service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:29.163635 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-7f4ab9c2-9fd1-42f0-9233-6cdc3755cd68 req-27a4e2bc-42aa-4a52-af23-723bfd00fa2e service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:29.163944 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-7f4ab9c2-9fd1-42f0-9233-6cdc3755cd68 req-27a4e2bc-42aa-4a52-af23-723bfd00fa2e service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:29.183037 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-7f4ab9c2-9fd1-42f0-9233-6cdc3755cd68 req-27a4e2bc-42aa-4a52-af23-723bfd00fa2e service nova] Creating event network-changed:d195d625-0e4f-449a-85ea-c38c152c8b70 for instance 42037737-e99b-49b9-9af0-c3aa68cfc09f on hv-cinder-85032 Sep 09 23:23:29.189696 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-7f4ab9c2-9fd1-42f0-9233-6cdc3755cd68 req-27a4e2bc-42aa-4a52-af23-723bfd00fa2e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046158 Sep 09 23:23:29.192927 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 173/325] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:23:29.203913 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-835bfa09-9865-4747-936c-c6c07d97a5dd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:29.205346 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-835bfa09-9865-4747-936c-c6c07d97a5dd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:29.219103 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-835bfa09-9865-4747-936c-c6c07d97a5dd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:29.219818 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-835bfa09-9865-4747-936c-c6c07d97a5dd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:29.220467 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-835bfa09-9865-4747-936c-c6c07d97a5dd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:29.221235 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-64ad976a-99e1-4454-a520-18f1b832438a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:29.221689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-835bfa09-9865-4747-936c-c6c07d97a5dd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:29.223704 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-835bfa09-9865-4747-936c-c6c07d97a5dd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:29.224363 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-835bfa09-9865-4747-936c-c6c07d97a5dd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:29.232832 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-64ad976a-99e1-4454-a520-18f1b832438a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1219 microversion: 2.1 time: 0.093651 Sep 09 23:23:29.235389 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 153/326] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:29 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:29.406021 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-835bfa09-9865-4747-936c-c6c07d97a5dd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:29.419145 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-835bfa09-9865-4747-936c-c6c07d97a5dd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1314 microversion: 2.1 time: 0.221820 Sep 09 23:23:29.419145 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 174/327] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:29 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:29.618146 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5a64c97f-76aa-4c01-a1d2-f8e85ff2388f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:29.621050 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5a64c97f-76aa-4c01-a1d2-f8e85ff2388f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:29.627544 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5a64c97f-76aa-4c01-a1d2-f8e85ff2388f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:29.628227 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5a64c97f-76aa-4c01-a1d2-f8e85ff2388f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:29.629436 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5a64c97f-76aa-4c01-a1d2-f8e85ff2388f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:29.630293 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5a64c97f-76aa-4c01-a1d2-f8e85ff2388f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:29.631039 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5a64c97f-76aa-4c01-a1d2-f8e85ff2388f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:29.631618 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5a64c97f-76aa-4c01-a1d2-f8e85ff2388f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:29.785072 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-1bb0318a-4e1d-4411-8dd1-0c0f91f0ae91 req-928e3078-06d3-4fdc-a954-a6e158de3dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff", "name": "network-vif-plugged", "status": "completed", "tag": "4ed06e43-5924-4dd9-b9a7-e0cbcd55d744"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:29.795889 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-1bb0318a-4e1d-4411-8dd1-0c0f91f0ae91 req-928e3078-06d3-4fdc-a954-a6e158de3dce service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:29.803859 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-1bb0318a-4e1d-4411-8dd1-0c0f91f0ae91 req-928e3078-06d3-4fdc-a954-a6e158de3dce service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:29.805049 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-1bb0318a-4e1d-4411-8dd1-0c0f91f0ae91 req-928e3078-06d3-4fdc-a954-a6e158de3dce service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:29.818547 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-1bb0318a-4e1d-4411-8dd1-0c0f91f0ae91 req-928e3078-06d3-4fdc-a954-a6e158de3dce service nova] Creating event network-vif-plugged:4ed06e43-5924-4dd9-b9a7-e0cbcd55d744 for instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff on hv-cinder-85032 Sep 09 23:23:29.823406 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-1bb0318a-4e1d-4411-8dd1-0c0f91f0ae91 req-928e3078-06d3-4fdc-a954-a6e158de3dce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042733 Sep 09 23:23:29.824199 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 175/328] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:23:29.855168 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5a64c97f-76aa-4c01-a1d2-f8e85ff2388f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:29.864059 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5a64c97f-76aa-4c01-a1d2-f8e85ff2388f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1370 microversion: 2.1 time: 0.250342 Sep 09 23:23:29.879043 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 154/329] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:29 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:29.920814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4a3b7f4f-1245-4d67-9bc5-b60ef6ee3f3f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:29.921521 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4a3b7f4f-1245-4d67-9bc5-b60ef6ee3f3f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:29.928845 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a3b7f4f-1245-4d67-9bc5-b60ef6ee3f3f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:29.929340 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a3b7f4f-1245-4d67-9bc5-b60ef6ee3f3f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:29.929781 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a3b7f4f-1245-4d67-9bc5-b60ef6ee3f3f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:29.930515 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a3b7f4f-1245-4d67-9bc5-b60ef6ee3f3f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:29.930979 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a3b7f4f-1245-4d67-9bc5-b60ef6ee3f3f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:29.931409 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a3b7f4f-1245-4d67-9bc5-b60ef6ee3f3f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:30.075536 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4a3b7f4f-1245-4d67-9bc5-b60ef6ee3f3f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:30.078726 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4a3b7f4f-1245-4d67-9bc5-b60ef6ee3f3f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1701 microversion: 2.1 time: 0.161806 Sep 09 23:23:30.079942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 176/330] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:29 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1701 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:30.115297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c4428f5d-f0f6-4565-bc74-c2e2f2f88599 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:30.122453 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c4428f5d-f0f6-4565-bc74-c2e2f2f88599 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:30.122943 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c4428f5d-f0f6-4565-bc74-c2e2f2f88599 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:30.123373 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c4428f5d-f0f6-4565-bc74-c2e2f2f88599 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:30.153032 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c4428f5d-f0f6-4565-bc74-c2e2f2f88599 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Going to try to start instance {{(pid=121058) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 23:23:30.258666 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5955d30f-0cd7-4f4d-a24f-238333fa868c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:30.259902 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5955d30f-0cd7-4f4d-a24f-238333fa868c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:30.266943 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5955d30f-0cd7-4f4d-a24f-238333fa868c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:30.267397 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5955d30f-0cd7-4f4d-a24f-238333fa868c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:30.267832 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5955d30f-0cd7-4f4d-a24f-238333fa868c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:30.271193 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5955d30f-0cd7-4f4d-a24f-238333fa868c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:30.271193 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5955d30f-0cd7-4f4d-a24f-238333fa868c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:30.271193 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5955d30f-0cd7-4f4d-a24f-238333fa868c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:30.328660 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c4428f5d-f0f6-4565-bc74-c2e2f2f88599 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "POST /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/action" status: 202 len: 0 microversion: 2.1 time: 0.219404 Sep 09 23:23:30.328660 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 155/331] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 23:23:30 2022] POST /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:23:30.335398 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5955d30f-0cd7-4f4d-a24f-238333fa868c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:30.338078 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-46097ba1-da96-42fc-b357-f0aac23efb5c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:30.338905 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-46097ba1-da96-42fc-b357-f0aac23efb5c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:30.343174 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5955d30f-0cd7-4f4d-a24f-238333fa868c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1223 microversion: 2.1 time: 0.088479 Sep 09 23:23:30.344003 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 177/332] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:30 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:30.345616 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-46097ba1-da96-42fc-b357-f0aac23efb5c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:30.346254 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-46097ba1-da96-42fc-b357-f0aac23efb5c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:30.347015 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-46097ba1-da96-42fc-b357-f0aac23efb5c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:30.351544 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-46097ba1-da96-42fc-b357-f0aac23efb5c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:30.351544 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-46097ba1-da96-42fc-b357-f0aac23efb5c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:30.351544 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-46097ba1-da96-42fc-b357-f0aac23efb5c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:30.442235 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-9a61dd59-b6dc-4423-8b56-2c61e66ca014 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:30.442889 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-9a61dd59-b6dc-4423-8b56-2c61e66ca014 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:30.449336 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9a61dd59-b6dc-4423-8b56-2c61e66ca014 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:30.449880 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9a61dd59-b6dc-4423-8b56-2c61e66ca014 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:30.450312 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9a61dd59-b6dc-4423-8b56-2c61e66ca014 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:30.451052 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9a61dd59-b6dc-4423-8b56-2c61e66ca014 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:30.451507 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9a61dd59-b6dc-4423-8b56-2c61e66ca014 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:30.451930 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9a61dd59-b6dc-4423-8b56-2c61e66ca014 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:30.489518 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-46097ba1-da96-42fc-b357-f0aac23efb5c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:30.498060 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-46097ba1-da96-42fc-b357-f0aac23efb5c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1710 microversion: 2.1 time: 0.164546 Sep 09 23:23:30.499244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 156/333] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:30 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1710 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:30.588350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-9a61dd59-b6dc-4423-8b56-2c61e66ca014 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:30.596138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-9a61dd59-b6dc-4423-8b56-2c61e66ca014 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1314 microversion: 2.1 time: 0.160021 Sep 09 23:23:30.596707 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 178/334] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:30 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:30.887532 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-be8128e5-35bc-4160-ae55-454caae6ff2f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:30.888280 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-be8128e5-35bc-4160-ae55-454caae6ff2f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:30.895453 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-be8128e5-35bc-4160-ae55-454caae6ff2f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:30.895947 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-be8128e5-35bc-4160-ae55-454caae6ff2f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:30.896387 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-be8128e5-35bc-4160-ae55-454caae6ff2f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:30.897093 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-be8128e5-35bc-4160-ae55-454caae6ff2f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:30.897548 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-be8128e5-35bc-4160-ae55-454caae6ff2f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:30.897975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-be8128e5-35bc-4160-ae55-454caae6ff2f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:31.031513 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-be8128e5-35bc-4160-ae55-454caae6ff2f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:31.039730 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-be8128e5-35bc-4160-ae55-454caae6ff2f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1370 microversion: 2.1 time: 0.156102 Sep 09 23:23:31.040298 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 157/335] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:30 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:31.367428 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8ed46e0d-5195-4aae-acb3-124165b493fc tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:31.368011 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8ed46e0d-5195-4aae-acb3-124165b493fc tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:31.374508 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8ed46e0d-5195-4aae-acb3-124165b493fc tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:31.374990 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8ed46e0d-5195-4aae-acb3-124165b493fc tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:31.375419 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8ed46e0d-5195-4aae-acb3-124165b493fc tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:31.376100 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8ed46e0d-5195-4aae-acb3-124165b493fc tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:31.376551 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8ed46e0d-5195-4aae-acb3-124165b493fc tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:31.376968 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8ed46e0d-5195-4aae-acb3-124165b493fc tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:31.439966 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8ed46e0d-5195-4aae-acb3-124165b493fc tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:31.448839 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8ed46e0d-5195-4aae-acb3-124165b493fc tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1215 microversion: 2.1 time: 0.085866 Sep 09 23:23:31.449415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 179/336] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:31 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:31.523416 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-88dd4d5e-134b-46a0-bb4e-013fdfbe7bd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:31.524041 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-88dd4d5e-134b-46a0-bb4e-013fdfbe7bd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:31.530110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-88dd4d5e-134b-46a0-bb4e-013fdfbe7bd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:31.530632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-88dd4d5e-134b-46a0-bb4e-013fdfbe7bd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:31.531169 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-88dd4d5e-134b-46a0-bb4e-013fdfbe7bd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:31.531868 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-88dd4d5e-134b-46a0-bb4e-013fdfbe7bd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:31.532328 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-88dd4d5e-134b-46a0-bb4e-013fdfbe7bd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:31.532764 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-88dd4d5e-134b-46a0-bb4e-013fdfbe7bd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:31.621787 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b95d3504-0aa9-4483-a70f-2cc828c062e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:31.622864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b95d3504-0aa9-4483-a70f-2cc828c062e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:31.639007 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b95d3504-0aa9-4483-a70f-2cc828c062e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:31.639503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b95d3504-0aa9-4483-a70f-2cc828c062e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:31.642067 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b95d3504-0aa9-4483-a70f-2cc828c062e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:31.642821 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b95d3504-0aa9-4483-a70f-2cc828c062e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:31.643280 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b95d3504-0aa9-4483-a70f-2cc828c062e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:31.643701 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b95d3504-0aa9-4483-a70f-2cc828c062e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:31.710225 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-88dd4d5e-134b-46a0-bb4e-013fdfbe7bd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:31.721879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-88dd4d5e-134b-46a0-bb4e-013fdfbe7bd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1710 microversion: 2.1 time: 0.202970 Sep 09 23:23:31.722582 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 158/337] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:31 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1710 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:31.784166 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b95d3504-0aa9-4483-a70f-2cc828c062e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:31.791941 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b95d3504-0aa9-4483-a70f-2cc828c062e5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1314 microversion: 2.1 time: 0.176276 Sep 09 23:23:31.792505 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 180/338] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:31 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:32.063583 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-67fd2375-81dc-4395-aade-5382b64fe6df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:32.064201 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-67fd2375-81dc-4395-aade-5382b64fe6df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:32.073719 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-67fd2375-81dc-4395-aade-5382b64fe6df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:32.073719 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-67fd2375-81dc-4395-aade-5382b64fe6df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:32.073719 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-67fd2375-81dc-4395-aade-5382b64fe6df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:32.073719 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-67fd2375-81dc-4395-aade-5382b64fe6df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:32.074198 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-67fd2375-81dc-4395-aade-5382b64fe6df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:32.074198 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-67fd2375-81dc-4395-aade-5382b64fe6df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:32.303482 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-67fd2375-81dc-4395-aade-5382b64fe6df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:32.311068 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-67fd2375-81dc-4395-aade-5382b64fe6df tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1370 microversion: 2.1 time: 0.251316 Sep 09 23:23:32.311631 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 159/339] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:32 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1370 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:32.474230 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1aafc31d-749d-4e5d-9481-96c6bce1d249 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:32.474894 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1aafc31d-749d-4e5d-9481-96c6bce1d249 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:32.481803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1aafc31d-749d-4e5d-9481-96c6bce1d249 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:32.482237 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1aafc31d-749d-4e5d-9481-96c6bce1d249 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:32.482703 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1aafc31d-749d-4e5d-9481-96c6bce1d249 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:32.483405 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1aafc31d-749d-4e5d-9481-96c6bce1d249 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:32.483864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1aafc31d-749d-4e5d-9481-96c6bce1d249 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:32.484299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1aafc31d-749d-4e5d-9481-96c6bce1d249 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:32.546628 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1aafc31d-749d-4e5d-9481-96c6bce1d249 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:32.554676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1aafc31d-749d-4e5d-9481-96c6bce1d249 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1271 microversion: 2.1 time: 0.085085 Sep 09 23:23:32.555229 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 181/340] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:32 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:32.748219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-92211aa9-58a9-4c96-b80d-08d20070adfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:32.748750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-92211aa9-58a9-4c96-b80d-08d20070adfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:32.756354 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-92211aa9-58a9-4c96-b80d-08d20070adfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:32.762401 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-92211aa9-58a9-4c96-b80d-08d20070adfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:32.762401 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-92211aa9-58a9-4c96-b80d-08d20070adfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:32.762401 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-92211aa9-58a9-4c96-b80d-08d20070adfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:32.762401 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-92211aa9-58a9-4c96-b80d-08d20070adfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:32.762871 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-92211aa9-58a9-4c96-b80d-08d20070adfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:32.815610 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ff34e1ec-4c17-40a8-a090-dfd5a2e3f1a1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:32.816752 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ff34e1ec-4c17-40a8-a090-dfd5a2e3f1a1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:32.823395 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff34e1ec-4c17-40a8-a090-dfd5a2e3f1a1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:32.824081 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff34e1ec-4c17-40a8-a090-dfd5a2e3f1a1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:32.824521 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff34e1ec-4c17-40a8-a090-dfd5a2e3f1a1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:32.825292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff34e1ec-4c17-40a8-a090-dfd5a2e3f1a1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:32.825746 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff34e1ec-4c17-40a8-a090-dfd5a2e3f1a1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:32.826320 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ff34e1ec-4c17-40a8-a090-dfd5a2e3f1a1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:32.900986 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-92211aa9-58a9-4c96-b80d-08d20070adfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:32.909216 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-92211aa9-58a9-4c96-b80d-08d20070adfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1710 microversion: 2.1 time: 0.164960 Sep 09 23:23:32.909778 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 160/341] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:32 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1710 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:32.962007 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ff34e1ec-4c17-40a8-a090-dfd5a2e3f1a1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:32.969716 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ff34e1ec-4c17-40a8-a090-dfd5a2e3f1a1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1314 microversion: 2.1 time: 0.158040 Sep 09 23:23:32.970271 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 182/342] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:32 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:33.333871 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-031357b1-72a0-42cf-a42a-86f679f0dac8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:33.334795 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-031357b1-72a0-42cf-a42a-86f679f0dac8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:33.342093 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-031357b1-72a0-42cf-a42a-86f679f0dac8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:33.342636 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-031357b1-72a0-42cf-a42a-86f679f0dac8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:33.343139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-031357b1-72a0-42cf-a42a-86f679f0dac8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:33.344455 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-031357b1-72a0-42cf-a42a-86f679f0dac8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:33.344943 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-031357b1-72a0-42cf-a42a-86f679f0dac8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:33.345387 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-031357b1-72a0-42cf-a42a-86f679f0dac8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:33.531244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-031357b1-72a0-42cf-a42a-86f679f0dac8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:33.539708 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-031357b1-72a0-42cf-a42a-86f679f0dac8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1563 microversion: 2.1 time: 0.209678 Sep 09 23:23:33.540396 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 161/343] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:33 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1563 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:33.564916 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a1f42830-93c8-4093-99aa-b4769b0f8eed tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:33.565446 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a1f42830-93c8-4093-99aa-b4769b0f8eed tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:33.572671 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a1f42830-93c8-4093-99aa-b4769b0f8eed tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:33.573188 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a1f42830-93c8-4093-99aa-b4769b0f8eed tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:33.573628 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a1f42830-93c8-4093-99aa-b4769b0f8eed tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:33.574611 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a1f42830-93c8-4093-99aa-b4769b0f8eed tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:33.575221 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a1f42830-93c8-4093-99aa-b4769b0f8eed tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:33.575658 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a1f42830-93c8-4093-99aa-b4769b0f8eed tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:33.578199 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b1e51614-e5af-4883-bafb-e1c6717cecd0 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:33.579448 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b1e51614-e5af-4883-bafb-e1c6717cecd0 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:33.586115 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1e51614-e5af-4883-bafb-e1c6717cecd0 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:33.586632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1e51614-e5af-4883-bafb-e1c6717cecd0 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:33.587066 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1e51614-e5af-4883-bafb-e1c6717cecd0 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:33.587761 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1e51614-e5af-4883-bafb-e1c6717cecd0 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:33.588212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1e51614-e5af-4883-bafb-e1c6717cecd0 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:33.588868 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1e51614-e5af-4883-bafb-e1c6717cecd0 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:33.681375 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a1f42830-93c8-4093-99aa-b4769b0f8eed tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120731 Sep 09 23:23:33.681963 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 183/344] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 23:23:33 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:23:33.701215 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b1e51614-e5af-4883-bafb-e1c6717cecd0 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:33.713805 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b1e51614-e5af-4883-bafb-e1c6717cecd0 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1279 microversion: 2.1 time: 0.138990 Sep 09 23:23:33.714732 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 162/345] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:33 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1279 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:33.933510 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4b81d32d-8feb-4c7b-8d60-9191e9518361 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:33.934213 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4b81d32d-8feb-4c7b-8d60-9191e9518361 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:33.940432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4b81d32d-8feb-4c7b-8d60-9191e9518361 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:33.940930 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4b81d32d-8feb-4c7b-8d60-9191e9518361 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:33.941980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4b81d32d-8feb-4c7b-8d60-9191e9518361 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:33.942927 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4b81d32d-8feb-4c7b-8d60-9191e9518361 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:33.944334 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4b81d32d-8feb-4c7b-8d60-9191e9518361 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:33.944974 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4b81d32d-8feb-4c7b-8d60-9191e9518361 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:33.994824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e0d23e2d-b49c-425c-a529-8be13091bed9 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:33.995711 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e0d23e2d-b49c-425c-a529-8be13091bed9 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:34.006128 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e0d23e2d-b49c-425c-a529-8be13091bed9 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:34.007119 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e0d23e2d-b49c-425c-a529-8be13091bed9 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:34.007119 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e0d23e2d-b49c-425c-a529-8be13091bed9 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:34.009802 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e0d23e2d-b49c-425c-a529-8be13091bed9 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:34.009802 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e0d23e2d-b49c-425c-a529-8be13091bed9 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:34.009802 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e0d23e2d-b49c-425c-a529-8be13091bed9 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:34.013140 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:34.227517 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4b81d32d-8feb-4c7b-8d60-9191e9518361 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:34.246856 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4b81d32d-8feb-4c7b-8d60-9191e9518361 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1710 microversion: 2.1 time: 0.317478 Sep 09 23:23:34.248223 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 184/346] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:33 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1710 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:34.518988 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e0d23e2d-b49c-425c-a529-8be13091bed9 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:34.529152 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e0d23e2d-b49c-425c-a529-8be13091bed9 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1314 microversion: 2.1 time: 0.539202 Sep 09 23:23:34.530336 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 163/347] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:33 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:34.739803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1dd595ba-1b09-4229-86f3-1c5d272cef55 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:34.741051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1dd595ba-1b09-4229-86f3-1c5d272cef55 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:34.748270 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1dd595ba-1b09-4229-86f3-1c5d272cef55 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:34.748755 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1dd595ba-1b09-4229-86f3-1c5d272cef55 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:34.749184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1dd595ba-1b09-4229-86f3-1c5d272cef55 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:34.750051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1dd595ba-1b09-4229-86f3-1c5d272cef55 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:34.750533 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1dd595ba-1b09-4229-86f3-1c5d272cef55 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:34.750958 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1dd595ba-1b09-4229-86f3-1c5d272cef55 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:34.825449 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1dd595ba-1b09-4229-86f3-1c5d272cef55 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:34.837518 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1dd595ba-1b09-4229-86f3-1c5d272cef55 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1277 microversion: 2.1 time: 0.103988 Sep 09 23:23:34.838075 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 185/348] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:34 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:35.190628 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-66498db1-5ede-449f-ae6a-160eb011bc9e req-e573ae50-bd3d-4905-bd7c-23456290b61a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff", "tag": "4ed06e43-5924-4dd9-b9a7-e0cbcd55d744"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:35.200375 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-66498db1-5ede-449f-ae6a-160eb011bc9e req-e573ae50-bd3d-4905-bd7c-23456290b61a service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:35.200857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-66498db1-5ede-449f-ae6a-160eb011bc9e req-e573ae50-bd3d-4905-bd7c-23456290b61a service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:35.201283 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-66498db1-5ede-449f-ae6a-160eb011bc9e req-e573ae50-bd3d-4905-bd7c-23456290b61a service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:35.212410 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-66498db1-5ede-449f-ae6a-160eb011bc9e req-e573ae50-bd3d-4905-bd7c-23456290b61a service nova] Creating event network-changed:4ed06e43-5924-4dd9-b9a7-e0cbcd55d744 for instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff on hv-cinder-85032 Sep 09 23:23:35.217526 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-66498db1-5ede-449f-ae6a-160eb011bc9e req-e573ae50-bd3d-4905-bd7c-23456290b61a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030663 Sep 09 23:23:35.220970 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 164/349] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:23:35.272599 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-594246d9-7847-4174-bdf4-3b2e305a7328 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:35.273421 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-594246d9-7847-4174-bdf4-3b2e305a7328 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:35.287528 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-594246d9-7847-4174-bdf4-3b2e305a7328 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:35.288365 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-594246d9-7847-4174-bdf4-3b2e305a7328 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:35.288816 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-594246d9-7847-4174-bdf4-3b2e305a7328 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:35.289548 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-594246d9-7847-4174-bdf4-3b2e305a7328 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:35.290008 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-594246d9-7847-4174-bdf4-3b2e305a7328 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:35.290471 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-594246d9-7847-4174-bdf4-3b2e305a7328 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:35.452318 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-594246d9-7847-4174-bdf4-3b2e305a7328 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:35.461485 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-594246d9-7847-4174-bdf4-3b2e305a7328 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1714 microversion: 2.1 time: 0.193974 Sep 09 23:23:35.462055 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 186/350] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:35 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1714 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:35.554154 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e38285b4-b3f6-4ee4-896c-4b707ec96fe1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:35.555052 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e38285b4-b3f6-4ee4-896c-4b707ec96fe1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:35.561290 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e38285b4-b3f6-4ee4-896c-4b707ec96fe1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:35.562071 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e38285b4-b3f6-4ee4-896c-4b707ec96fe1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:35.562754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e38285b4-b3f6-4ee4-896c-4b707ec96fe1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:35.563640 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e38285b4-b3f6-4ee4-896c-4b707ec96fe1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:35.564648 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e38285b4-b3f6-4ee4-896c-4b707ec96fe1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:35.565273 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e38285b4-b3f6-4ee4-896c-4b707ec96fe1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:35.831306 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e38285b4-b3f6-4ee4-896c-4b707ec96fe1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:35.840772 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e38285b4-b3f6-4ee4-896c-4b707ec96fe1 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1314 microversion: 2.1 time: 0.291425 Sep 09 23:23:35.841342 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 165/351] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:35 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:35.863832 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5de47663-1298-49ef-b85c-0350a6e66705 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:35.865118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5de47663-1298-49ef-b85c-0350a6e66705 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:35.871662 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5de47663-1298-49ef-b85c-0350a6e66705 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:35.872488 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5de47663-1298-49ef-b85c-0350a6e66705 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:35.878041 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5de47663-1298-49ef-b85c-0350a6e66705 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:35.878041 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5de47663-1298-49ef-b85c-0350a6e66705 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:35.878041 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5de47663-1298-49ef-b85c-0350a6e66705 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:35.878041 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5de47663-1298-49ef-b85c-0350a6e66705 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:36.006054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-90477815-cb00-4f26-93d7-cf6275571a6c req-6881130c-a0ed-4ef7-aed2-eecf3b23d234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42037737-e99b-49b9-9af0-c3aa68cfc09f", "name": "network-vif-plugged", "status": "completed", "tag": "d195d625-0e4f-449a-85ea-c38c152c8b70"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:36.015561 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-90477815-cb00-4f26-93d7-cf6275571a6c req-6881130c-a0ed-4ef7-aed2-eecf3b23d234 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:36.016391 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-90477815-cb00-4f26-93d7-cf6275571a6c req-6881130c-a0ed-4ef7-aed2-eecf3b23d234 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:36.016822 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-90477815-cb00-4f26-93d7-cf6275571a6c req-6881130c-a0ed-4ef7-aed2-eecf3b23d234 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:36.034651 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-90477815-cb00-4f26-93d7-cf6275571a6c req-6881130c-a0ed-4ef7-aed2-eecf3b23d234 service nova] Creating event network-vif-plugged:d195d625-0e4f-449a-85ea-c38c152c8b70 for instance 42037737-e99b-49b9-9af0-c3aa68cfc09f on hv-cinder-85032 Sep 09 23:23:36.041033 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-90477815-cb00-4f26-93d7-cf6275571a6c req-6881130c-a0ed-4ef7-aed2-eecf3b23d234 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041658 Sep 09 23:23:36.044709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5de47663-1298-49ef-b85c-0350a6e66705 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:36.052953 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 166/352] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:23:36.057684 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5de47663-1298-49ef-b85c-0350a6e66705 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1319 microversion: 2.1 time: 0.200477 Sep 09 23:23:36.071058 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 187/353] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:35 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:36.492336 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-4928ec2d-b30a-4dd2-a41b-1af0390b4830 req-b666df47-f79f-459a-9108-a5d491fd36fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fdcb60-b9f8-44ec-af74-562b06e49760", "tag": "3ac8b0ba-fec9-49ec-81bc-e839b52e5405"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:36.510894 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-4928ec2d-b30a-4dd2-a41b-1af0390b4830 req-b666df47-f79f-459a-9108-a5d491fd36fa service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:36.511408 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-4928ec2d-b30a-4dd2-a41b-1af0390b4830 req-b666df47-f79f-459a-9108-a5d491fd36fa service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:36.511847 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-4928ec2d-b30a-4dd2-a41b-1af0390b4830 req-b666df47-f79f-459a-9108-a5d491fd36fa service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:36.524620 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-4928ec2d-b30a-4dd2-a41b-1af0390b4830 req-b666df47-f79f-459a-9108-a5d491fd36fa service nova] Creating event network-changed:3ac8b0ba-fec9-49ec-81bc-e839b52e5405 for instance f3fdcb60-b9f8-44ec-af74-562b06e49760 on hv-cinder-85032 Sep 09 23:23:36.529374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-4928ec2d-b30a-4dd2-a41b-1af0390b4830 req-b666df47-f79f-459a-9108-a5d491fd36fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041156 Sep 09 23:23:36.529971 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 167/354] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:23:36.864225 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c923e336-72db-40af-8b17-a4cf96207a24 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:36.864871 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-c923e336-72db-40af-8b17-a4cf96207a24 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:36.871168 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c923e336-72db-40af-8b17-a4cf96207a24 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:36.871651 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c923e336-72db-40af-8b17-a4cf96207a24 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:36.872087 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c923e336-72db-40af-8b17-a4cf96207a24 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:36.872811 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c923e336-72db-40af-8b17-a4cf96207a24 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:36.873268 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c923e336-72db-40af-8b17-a4cf96207a24 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:36.873697 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c923e336-72db-40af-8b17-a4cf96207a24 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:37.012775 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-c923e336-72db-40af-8b17-a4cf96207a24 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:37.021080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-c923e336-72db-40af-8b17-a4cf96207a24 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1314 microversion: 2.1 time: 0.161333 Sep 09 23:23:37.021729 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 188/355] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:36 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:37.094111 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b2d0c212-59f5-4389-aadb-df228de52510 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:37.094839 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b2d0c212-59f5-4389-aadb-df228de52510 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:37.101326 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b2d0c212-59f5-4389-aadb-df228de52510 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:37.101729 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b2d0c212-59f5-4389-aadb-df228de52510 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:37.102170 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b2d0c212-59f5-4389-aadb-df228de52510 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:37.102981 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b2d0c212-59f5-4389-aadb-df228de52510 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:37.103452 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b2d0c212-59f5-4389-aadb-df228de52510 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:37.103882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b2d0c212-59f5-4389-aadb-df228de52510 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:37.242168 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b2d0c212-59f5-4389-aadb-df228de52510 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:37.249914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b2d0c212-59f5-4389-aadb-df228de52510 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1319 microversion: 2.1 time: 0.160467 Sep 09 23:23:37.250511 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 168/356] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:37 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:38.045347 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8b5ae2fb-f742-446f-995a-1a0b58ca59d5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:38.045888 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8b5ae2fb-f742-446f-995a-1a0b58ca59d5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:38.052504 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b5ae2fb-f742-446f-995a-1a0b58ca59d5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:38.052986 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b5ae2fb-f742-446f-995a-1a0b58ca59d5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:38.053422 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b5ae2fb-f742-446f-995a-1a0b58ca59d5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:38.054106 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b5ae2fb-f742-446f-995a-1a0b58ca59d5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:38.054593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b5ae2fb-f742-446f-995a-1a0b58ca59d5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:38.055021 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b5ae2fb-f742-446f-995a-1a0b58ca59d5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:38.187447 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8b5ae2fb-f742-446f-995a-1a0b58ca59d5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:38.195721 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8b5ae2fb-f742-446f-995a-1a0b58ca59d5 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1314 microversion: 2.1 time: 0.154428 Sep 09 23:23:38.196314 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 189/357] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:38 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:38.273696 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-f99b54c0-3113-4b2e-8fbe-3cf4a9cc6827 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:38.274300 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-f99b54c0-3113-4b2e-8fbe-3cf4a9cc6827 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:38.280457 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f99b54c0-3113-4b2e-8fbe-3cf4a9cc6827 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:38.280939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f99b54c0-3113-4b2e-8fbe-3cf4a9cc6827 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:38.281381 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f99b54c0-3113-4b2e-8fbe-3cf4a9cc6827 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:38.282074 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f99b54c0-3113-4b2e-8fbe-3cf4a9cc6827 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:38.282565 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f99b54c0-3113-4b2e-8fbe-3cf4a9cc6827 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:38.282991 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f99b54c0-3113-4b2e-8fbe-3cf4a9cc6827 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:38.474792 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-f99b54c0-3113-4b2e-8fbe-3cf4a9cc6827 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:38.483721 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-f99b54c0-3113-4b2e-8fbe-3cf4a9cc6827 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1319 microversion: 2.1 time: 0.214495 Sep 09 23:23:38.484994 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 169/358] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:38 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:39.219607 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1c31d507-4da6-4ed8-8cf3-87f1c66a426b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:39.220224 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1c31d507-4da6-4ed8-8cf3-87f1c66a426b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:39.222231 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=4 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:39.222951 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=14 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:39.228263 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1c31d507-4da6-4ed8-8cf3-87f1c66a426b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:39.229579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1c31d507-4da6-4ed8-8cf3-87f1c66a426b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:39.229579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1c31d507-4da6-4ed8-8cf3-87f1c66a426b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:39.230061 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1c31d507-4da6-4ed8-8cf3-87f1c66a426b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:39.230578 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1c31d507-4da6-4ed8-8cf3-87f1c66a426b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:39.231044 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1c31d507-4da6-4ed8-8cf3-87f1c66a426b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:39.251101 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=100 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:39.382935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1c31d507-4da6-4ed8-8cf3-87f1c66a426b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:39.390617 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1c31d507-4da6-4ed8-8cf3-87f1c66a426b tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1497 microversion: 2.1 time: 0.175009 Sep 09 23:23:39.391185 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 190/359] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:39 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:39.509253 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9cd90af9-120b-4eda-acc2-d0b32539eaa4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:39.509821 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9cd90af9-120b-4eda-acc2-d0b32539eaa4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:39.511898 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=2 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:39.517071 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9cd90af9-120b-4eda-acc2-d0b32539eaa4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:39.517535 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9cd90af9-120b-4eda-acc2-d0b32539eaa4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:39.517966 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9cd90af9-120b-4eda-acc2-d0b32539eaa4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:39.518683 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9cd90af9-120b-4eda-acc2-d0b32539eaa4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:39.519136 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9cd90af9-120b-4eda-acc2-d0b32539eaa4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:39.519557 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9cd90af9-120b-4eda-acc2-d0b32539eaa4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:39.654460 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9cd90af9-120b-4eda-acc2-d0b32539eaa4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:39.659836 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9cd90af9-120b-4eda-acc2-d0b32539eaa4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1319 microversion: 2.1 time: 0.155145 Sep 09 23:23:39.660463 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 170/360] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:39 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:40.194791 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3b531ce5-0dc4-4708-8294-fae858dffcad tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:40.195258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3b531ce5-0dc4-4708-8294-fae858dffcad tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:40.201217 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b531ce5-0dc4-4708-8294-fae858dffcad tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:40.201692 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b531ce5-0dc4-4708-8294-fae858dffcad tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:40.202121 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b531ce5-0dc4-4708-8294-fae858dffcad tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:40.202823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b531ce5-0dc4-4708-8294-fae858dffcad tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:40.203275 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b531ce5-0dc4-4708-8294-fae858dffcad tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:40.203729 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b531ce5-0dc4-4708-8294-fae858dffcad tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:40.229987 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3b531ce5-0dc4-4708-8294-fae858dffcad tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Going to try to terminate instance {{(pid=121059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:23:40.506698 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3b531ce5-0dc4-4708-8294-fae858dffcad tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 204 len: 0 microversion: 2.1 time: 0.316243 Sep 09 23:23:40.507384 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 191/361] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:23:40 2022] DELETE /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:23:40.515665 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-614582fd-4204-47c4-bbeb-7c9cf2ff8f27 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:40.516228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-614582fd-4204-47c4-bbeb-7c9cf2ff8f27 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:40.522665 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-614582fd-4204-47c4-bbeb-7c9cf2ff8f27 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:40.523865 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-614582fd-4204-47c4-bbeb-7c9cf2ff8f27 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:40.524654 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-614582fd-4204-47c4-bbeb-7c9cf2ff8f27 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:40.525373 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-614582fd-4204-47c4-bbeb-7c9cf2ff8f27 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:40.525823 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-614582fd-4204-47c4-bbeb-7c9cf2ff8f27 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:40.526251 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-614582fd-4204-47c4-bbeb-7c9cf2ff8f27 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:40.664094 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-614582fd-4204-47c4-bbeb-7c9cf2ff8f27 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:40.672467 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-614582fd-4204-47c4-bbeb-7c9cf2ff8f27 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1503 microversion: 2.1 time: 0.160704 Sep 09 23:23:40.673030 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 171/362] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:40 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:23:40.684493 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7145b808-654c-434b-8fa2-e6f99f559da2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:40.685486 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7145b808-654c-434b-8fa2-e6f99f559da2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:40.693140 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7145b808-654c-434b-8fa2-e6f99f559da2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:40.693923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7145b808-654c-434b-8fa2-e6f99f559da2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:40.694700 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7145b808-654c-434b-8fa2-e6f99f559da2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:40.695894 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7145b808-654c-434b-8fa2-e6f99f559da2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:40.696360 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7145b808-654c-434b-8fa2-e6f99f559da2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:40.696795 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7145b808-654c-434b-8fa2-e6f99f559da2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:40.836086 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7145b808-654c-434b-8fa2-e6f99f559da2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:40.844182 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7145b808-654c-434b-8fa2-e6f99f559da2 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1319 microversion: 2.1 time: 0.164661 Sep 09 23:23:40.844769 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 192/363] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:40 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:41.695880 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c6262b29-5b50-474c-8ca9-a32e9a5b37e3 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:41.696609 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c6262b29-5b50-474c-8ca9-a32e9a5b37e3 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:41.703548 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c6262b29-5b50-474c-8ca9-a32e9a5b37e3 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:41.704140 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c6262b29-5b50-474c-8ca9-a32e9a5b37e3 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:41.704585 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c6262b29-5b50-474c-8ca9-a32e9a5b37e3 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:41.705295 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c6262b29-5b50-474c-8ca9-a32e9a5b37e3 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:41.705753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c6262b29-5b50-474c-8ca9-a32e9a5b37e3 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:41.706183 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c6262b29-5b50-474c-8ca9-a32e9a5b37e3 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:41.839872 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c6262b29-5b50-474c-8ca9-a32e9a5b37e3 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:41.847912 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c6262b29-5b50-474c-8ca9-a32e9a5b37e3 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1503 microversion: 2.1 time: 0.156104 Sep 09 23:23:41.848573 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 172/364] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:41 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:41.867997 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4c4124e0-2240-426d-b72b-06c71e94b16f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:41.869372 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4c4124e0-2240-426d-b72b-06c71e94b16f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:41.875934 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c4124e0-2240-426d-b72b-06c71e94b16f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:41.876549 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c4124e0-2240-426d-b72b-06c71e94b16f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:41.877052 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c4124e0-2240-426d-b72b-06c71e94b16f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:41.877818 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c4124e0-2240-426d-b72b-06c71e94b16f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:41.878367 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c4124e0-2240-426d-b72b-06c71e94b16f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:41.878867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c4124e0-2240-426d-b72b-06c71e94b16f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:42.013391 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4c4124e0-2240-426d-b72b-06c71e94b16f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:42.021113 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4c4124e0-2240-426d-b72b-06c71e94b16f tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1319 microversion: 2.1 time: 0.156918 Sep 09 23:23:42.021687 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 193/365] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:41 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:42.778275 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-857a37de-29c4-4960-ae59-c5f10968a534 req-e18eb19b-f309-4189-8977-c7305b3e7b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42037737-e99b-49b9-9af0-c3aa68cfc09f", "name": "network-vif-deleted", "tag": "d195d625-0e4f-449a-85ea-c38c152c8b70"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:42.787887 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-857a37de-29c4-4960-ae59-c5f10968a534 req-e18eb19b-f309-4189-8977-c7305b3e7b88 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:42.788360 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-857a37de-29c4-4960-ae59-c5f10968a534 req-e18eb19b-f309-4189-8977-c7305b3e7b88 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:42.788785 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-857a37de-29c4-4960-ae59-c5f10968a534 req-e18eb19b-f309-4189-8977-c7305b3e7b88 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:42.800046 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-857a37de-29c4-4960-ae59-c5f10968a534 req-e18eb19b-f309-4189-8977-c7305b3e7b88 service nova] Creating event network-vif-deleted:d195d625-0e4f-449a-85ea-c38c152c8b70 for instance 42037737-e99b-49b9-9af0-c3aa68cfc09f on hv-cinder-85032 Sep 09 23:23:42.804946 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-857a37de-29c4-4960-ae59-c5f10968a534 req-e18eb19b-f309-4189-8977-c7305b3e7b88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030899 Sep 09 23:23:42.805531 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 173/366] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:23:42.872038 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-97f2a18d-d9c8-47e4-a12d-2b06eab49867 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:42.872646 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-97f2a18d-d9c8-47e4-a12d-2b06eab49867 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:42.875126 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:42.879723 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-97f2a18d-d9c8-47e4-a12d-2b06eab49867 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:42.880200 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-97f2a18d-d9c8-47e4-a12d-2b06eab49867 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:42.880630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-97f2a18d-d9c8-47e4-a12d-2b06eab49867 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:42.885448 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-97f2a18d-d9c8-47e4-a12d-2b06eab49867 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:42.885993 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-97f2a18d-d9c8-47e4-a12d-2b06eab49867 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:42.886447 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-97f2a18d-d9c8-47e4-a12d-2b06eab49867 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:42.958316 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-97f2a18d-d9c8-47e4-a12d-2b06eab49867 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:42.966746 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-97f2a18d-d9c8-47e4-a12d-2b06eab49867 tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1299 microversion: 2.1 time: 0.098773 Sep 09 23:23:42.967315 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 194/367] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:42 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:43.044486 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-43a99750-2dd6-4fbb-9211-bf8ca2d8a0e7 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:43.045179 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-43a99750-2dd6-4fbb-9211-bf8ca2d8a0e7 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:43.051383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43a99750-2dd6-4fbb-9211-bf8ca2d8a0e7 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:43.051863 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43a99750-2dd6-4fbb-9211-bf8ca2d8a0e7 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:43.052290 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43a99750-2dd6-4fbb-9211-bf8ca2d8a0e7 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:43.052971 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43a99750-2dd6-4fbb-9211-bf8ca2d8a0e7 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:43.053416 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43a99750-2dd6-4fbb-9211-bf8ca2d8a0e7 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:43.053836 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43a99750-2dd6-4fbb-9211-bf8ca2d8a0e7 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:43.189298 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-43a99750-2dd6-4fbb-9211-bf8ca2d8a0e7 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:43.197058 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-43a99750-2dd6-4fbb-9211-bf8ca2d8a0e7 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1319 microversion: 2.1 time: 0.156748 Sep 09 23:23:43.197623 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 174/368] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:43 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:43.835510 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-f66dade3-6c22-4267-a600-f7150fb3571a req-f938a4e9-084b-4202-81df-030b0ac6b77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fdcb60-b9f8-44ec-af74-562b06e49760", "name": "network-vif-plugged", "status": "completed", "tag": "3ac8b0ba-fec9-49ec-81bc-e839b52e5405"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:43.850836 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-f66dade3-6c22-4267-a600-f7150fb3571a req-f938a4e9-084b-4202-81df-030b0ac6b77a service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:43.850836 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-f66dade3-6c22-4267-a600-f7150fb3571a req-f938a4e9-084b-4202-81df-030b0ac6b77a service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:43.850836 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-f66dade3-6c22-4267-a600-f7150fb3571a req-f938a4e9-084b-4202-81df-030b0ac6b77a service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:43.857583 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-f66dade3-6c22-4267-a600-f7150fb3571a req-f938a4e9-084b-4202-81df-030b0ac6b77a service nova] Creating event network-vif-plugged:3ac8b0ba-fec9-49ec-81bc-e839b52e5405 for instance f3fdcb60-b9f8-44ec-af74-562b06e49760 on hv-cinder-85032 Sep 09 23:23:43.862474 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-f66dade3-6c22-4267-a600-f7150fb3571a req-f938a4e9-084b-4202-81df-030b0ac6b77a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030993 Sep 09 23:23:43.863099 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 195/369] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:23:43.991002 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-606e09b3-de68-4719-bdfc-732a8dc0cacd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:43.991648 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-606e09b3-de68-4719-bdfc-732a8dc0cacd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:43.998727 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-606e09b3-de68-4719-bdfc-732a8dc0cacd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:43.999200 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-606e09b3-de68-4719-bdfc-732a8dc0cacd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:43.999630 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-606e09b3-de68-4719-bdfc-732a8dc0cacd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:44.000310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-606e09b3-de68-4719-bdfc-732a8dc0cacd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:44.000762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-606e09b3-de68-4719-bdfc-732a8dc0cacd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:44.001178 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-606e09b3-de68-4719-bdfc-732a8dc0cacd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:44.027813 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=100 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:23:44.032319 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-606e09b3-de68-4719-bdfc-732a8dc0cacd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:44.032790 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-606e09b3-de68-4719-bdfc-732a8dc0cacd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:44.033221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-606e09b3-de68-4719-bdfc-732a8dc0cacd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:44.033656 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-606e09b3-de68-4719-bdfc-732a8dc0cacd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lazy-loading 'fault' on Instance uuid 42037737-e99b-49b9-9af0-c3aa68cfc09f {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:23:44.074842 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-606e09b3-de68-4719-bdfc-732a8dc0cacd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c27b297062483598cf8ff5185e2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a4181be7e6404487bd7eddca1f6d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:44.082033 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-606e09b3-de68-4719-bdfc-732a8dc0cacd tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 200 len: 1304 microversion: 2.1 time: 0.094828 Sep 09 23:23:44.082665 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 175/370] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:43 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:44.220897 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-48aaed4b-8be8-41e3-8361-e3d98ea2dd7a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:44.221519 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-48aaed4b-8be8-41e3-8361-e3d98ea2dd7a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:44.228442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-48aaed4b-8be8-41e3-8361-e3d98ea2dd7a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:44.234098 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-48aaed4b-8be8-41e3-8361-e3d98ea2dd7a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:44.234098 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-48aaed4b-8be8-41e3-8361-e3d98ea2dd7a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:44.234098 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-48aaed4b-8be8-41e3-8361-e3d98ea2dd7a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:44.234098 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-48aaed4b-8be8-41e3-8361-e3d98ea2dd7a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:44.234565 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-48aaed4b-8be8-41e3-8361-e3d98ea2dd7a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:44.359796 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-48aaed4b-8be8-41e3-8361-e3d98ea2dd7a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:44.367639 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-48aaed4b-8be8-41e3-8361-e3d98ea2dd7a tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1319 microversion: 2.1 time: 0.151912 Sep 09 23:23:44.368254 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 196/371] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:44 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:45.106968 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-404f8c70-397e-473f-9d32-465a0b33741d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:45.107575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-404f8c70-397e-473f-9d32-465a0b33741d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] [instance: 42037737-e99b-49b9-9af0-c3aa68cfc09f] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:45.114423 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-404f8c70-397e-473f-9d32-465a0b33741d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:45.114947 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-404f8c70-397e-473f-9d32-465a0b33741d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:45.115379 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-404f8c70-397e-473f-9d32-465a0b33741d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:45.116084 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-404f8c70-397e-473f-9d32-465a0b33741d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:45.116534 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-404f8c70-397e-473f-9d32-465a0b33741d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:45.116987 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-404f8c70-397e-473f-9d32-465a0b33741d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:45.130628 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-404f8c70-397e-473f-9d32-465a0b33741d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] HTTP exception thrown: Instance 42037737-e99b-49b9-9af0-c3aa68cfc09f could not be found. Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-404f8c70-397e-473f-9d32-465a0b33741d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Request method failure captured: Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f HTTP/1.1 Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8rFYecm37vueSJm7cEdIl6T5C03GLdyAF7MQNgBusH6PGV8mLt9yK0tDBmI_SMeuTvg1Iy9LlyKQc_vN3I7r-nauEGp49p3gvJqMTtZhwmVQYX8gpEGgHi-hRSv8RIgXQHW3Nf6tNgg7EltW9Mj17SFYdXhE4RVjNWoWdxKkoaxWCs Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 44a4181be7e6404487bd7eddca1f6d8c Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-VolumesActionsTest-1115233279 Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:23:45.135143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:23:45.136770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/44a4181be7e6404487bd7eddca1f6d8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/44a4181be7e6404487bd7eddca1f6d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/44a4181be7e6404487bd7eddca1f6d8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_44a4181be7e6404487bd7eddca1f6d8c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:23:45.136770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-VolumesActionsTest-1115233279 Sep 09 23:23:45.136770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 44a4181be7e6404487bd7eddca1f6d8c Sep 09 23:23:45.136770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-VolumesActionsTest-1115233279 Sep 09 23:23:45.136770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-VolumesActionsTest-1115233279-project Sep 09 23:23:45.136770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:23:45.136770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:23:45.136770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 75c27b297062483598cf8ff5185e2f2a Sep 09 23:23:45.136770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-VolumesActionsTest-1115233279-project Sep 09 23:23:45.136770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:23:45.136770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 42037737-e99b-49b9-9af0-c3aa68cfc09f could not be found. Sep 09 23:23:45.136770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '42037737-e99b-49b9-9af0-c3aa68cfc09f'} Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42037737-e99b-49b9-9af0-c3aa68cfc09f could not be found. Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:23:45.137542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42037737-e99b-49b9-9af0-c3aa68cfc09f could not be found. Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42037737-e99b-49b9-9af0-c3aa68cfc09f could not be found. Sep 09 23:23:45.138763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:23:45.140233 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-404f8c70-397e-473f-9d32-465a0b33741d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] Returning 404 to user: Instance 42037737-e99b-49b9-9af0-c3aa68cfc09f could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:23:45.140233 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-404f8c70-397e-473f-9d32-465a0b33741d tempest-VolumesActionsTest-1115233279 tempest-VolumesActionsTest-1115233279-project] 10.222.0.20 "GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f" status: 404 len: 111 microversion: 2.1 time: 0.030991 Sep 09 23:23:45.140233 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 176/372] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:45 2022] GET /compute/v2.1/servers/42037737-e99b-49b9-9af0-c3aa68cfc09f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:23:45.390193 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-542e0871-5eb6-445e-9d9a-e08ace4fed90 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:45.390881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-542e0871-5eb6-445e-9d9a-e08ace4fed90 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:45.397348 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-542e0871-5eb6-445e-9d9a-e08ace4fed90 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:45.397836 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-542e0871-5eb6-445e-9d9a-e08ace4fed90 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:45.398278 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-542e0871-5eb6-445e-9d9a-e08ace4fed90 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:45.398994 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-542e0871-5eb6-445e-9d9a-e08ace4fed90 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:45.399500 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-542e0871-5eb6-445e-9d9a-e08ace4fed90 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:45.399939 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-542e0871-5eb6-445e-9d9a-e08ace4fed90 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:45.538938 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-542e0871-5eb6-445e-9d9a-e08ace4fed90 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:45.547309 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-542e0871-5eb6-445e-9d9a-e08ace4fed90 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1319 microversion: 2.1 time: 0.160943 Sep 09 23:23:45.547918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 197/373] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:45 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:46.570513 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b6d24cf3-e59a-4bcf-9ab8-41b0b3187de4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:46.571127 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b6d24cf3-e59a-4bcf-9ab8-41b0b3187de4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:46.578503 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b6d24cf3-e59a-4bcf-9ab8-41b0b3187de4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:46.579043 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b6d24cf3-e59a-4bcf-9ab8-41b0b3187de4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:46.579477 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b6d24cf3-e59a-4bcf-9ab8-41b0b3187de4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:46.580162 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b6d24cf3-e59a-4bcf-9ab8-41b0b3187de4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:46.580610 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b6d24cf3-e59a-4bcf-9ab8-41b0b3187de4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:46.581030 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b6d24cf3-e59a-4bcf-9ab8-41b0b3187de4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:46.711658 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b6d24cf3-e59a-4bcf-9ab8-41b0b3187de4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:46.719553 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b6d24cf3-e59a-4bcf-9ab8-41b0b3187de4 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1508 microversion: 2.1 time: 0.152982 Sep 09 23:23:46.720115 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 177/374] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:23:46 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:23:46.745188 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e0a4fbd6-8bce-4b11-b6f9-ba5f0b32668c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "caff01b0-7c04-4901-95b7-2ce9e42d3942", "device": "/dev/sdb"}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:46.748101 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e0a4fbd6-8bce-4b11-b6f9-ba5f0b32668c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:46.754534 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e0a4fbd6-8bce-4b11-b6f9-ba5f0b32668c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:46.755016 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e0a4fbd6-8bce-4b11-b6f9-ba5f0b32668c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:46.755442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e0a4fbd6-8bce-4b11-b6f9-ba5f0b32668c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:46.756130 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e0a4fbd6-8bce-4b11-b6f9-ba5f0b32668c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:46.756579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e0a4fbd6-8bce-4b11-b6f9-ba5f0b32668c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:46.756995 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e0a4fbd6-8bce-4b11-b6f9-ba5f0b32668c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:49.197374 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e0a4fbd6-8bce-4b11-b6f9-ba5f0b32668c tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "POST /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.457561 Sep 09 23:23:49.198045 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 198/375] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 23:23:46 2022] POST /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760/os-volume_attachments => generated 194 bytes in 2460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:23:51.955413 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c1c2c282-598f-4ab1-9829-d48845937ac2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:51.955986 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c1c2c282-598f-4ab1-9829-d48845937ac2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:51.962448 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1c2c282-598f-4ab1-9829-d48845937ac2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:51.962933 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1c2c282-598f-4ab1-9829-d48845937ac2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:51.963397 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1c2c282-598f-4ab1-9829-d48845937ac2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:51.964094 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1c2c282-598f-4ab1-9829-d48845937ac2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:51.964544 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1c2c282-598f-4ab1-9829-d48845937ac2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:51.964975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c1c2c282-598f-4ab1-9829-d48845937ac2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:51.991645 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c1c2c282-598f-4ab1-9829-d48845937ac2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/ips" status: 200 len: 150 microversion: 2.20 time: 0.040164 Sep 09 23:23:51.992796 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 178/376] 10.222.0.20 () {60 vars in 1289 bytes} [Fri Sep 9 23:23:51 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:23:55.520994 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7264ee8b-dcf2-42a4-b04c-c84915e249e1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:23:55.524817 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7264ee8b-dcf2-42a4-b04c-c84915e249e1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:55.533728 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7264ee8b-dcf2-42a4-b04c-c84915e249e1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:55.550278 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7264ee8b-dcf2-42a4-b04c-c84915e249e1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:55.550278 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7264ee8b-dcf2-42a4-b04c-c84915e249e1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:55.550278 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7264ee8b-dcf2-42a4-b04c-c84915e249e1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:55.550278 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7264ee8b-dcf2-42a4-b04c-c84915e249e1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:55.550723 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7264ee8b-dcf2-42a4-b04c-c84915e249e1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:55.564009 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-7264ee8b-dcf2-42a4-b04c-c84915e249e1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lazy-loading 'flavor' on Instance uuid 61a8b2e1-79be-4c0d-b316-94c95ae04638 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:23:56.124491 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7264ee8b-dcf2-42a4-b04c-c84915e249e1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "POST /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/action" status: 202 len: 0 microversion: 2.20 time: 0.608428 Sep 09 23:23:56.125472 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 199/377] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Sep 9 23:23:55 2022] POST /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:23:56.139265 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7b9910a0-3a85-442d-98a0-f6173a4ac110 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:56.143409 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7b9910a0-3a85-442d-98a0-f6173a4ac110 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:56.156310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7b9910a0-3a85-442d-98a0-f6173a4ac110 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:56.157054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7b9910a0-3a85-442d-98a0-f6173a4ac110 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:56.157937 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7b9910a0-3a85-442d-98a0-f6173a4ac110 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:56.158849 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7b9910a0-3a85-442d-98a0-f6173a4ac110 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:56.159477 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7b9910a0-3a85-442d-98a0-f6173a4ac110 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:56.159903 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7b9910a0-3a85-442d-98a0-f6173a4ac110 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:56.352946 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7b9910a0-3a85-442d-98a0-f6173a4ac110 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:56.368428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7b9910a0-3a85-442d-98a0-f6173a4ac110 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:56.370501 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7b9910a0-3a85-442d-98a0-f6173a4ac110 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:56.371897 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7b9910a0-3a85-442d-98a0-f6173a4ac110 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.238861 Sep 09 23:23:56.385167 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 179/378] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:23:56 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:23:57.410568 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-80471f57-962f-4d49-84d6-7d4129ddd116 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:57.411942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-80471f57-962f-4d49-84d6-7d4129ddd116 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:57.428597 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-80471f57-962f-4d49-84d6-7d4129ddd116 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:57.429272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-80471f57-962f-4d49-84d6-7d4129ddd116 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:57.430228 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-80471f57-962f-4d49-84d6-7d4129ddd116 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:57.431554 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-80471f57-962f-4d49-84d6-7d4129ddd116 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:57.435052 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-80471f57-962f-4d49-84d6-7d4129ddd116 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:57.435783 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-80471f57-962f-4d49-84d6-7d4129ddd116 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:57.598629 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-80471f57-962f-4d49-84d6-7d4129ddd116 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:57.608052 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-80471f57-962f-4d49-84d6-7d4129ddd116 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:57.609518 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-80471f57-962f-4d49-84d6-7d4129ddd116 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:57.610745 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-80471f57-962f-4d49-84d6-7d4129ddd116 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.205422 Sep 09 23:23:57.611318 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 200/379] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:23:57 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:23:58.637395 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7f638665-4e19-4c45-b173-5746224d871e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:58.639189 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7f638665-4e19-4c45-b173-5746224d871e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:58.651791 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f638665-4e19-4c45-b173-5746224d871e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:58.658377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f638665-4e19-4c45-b173-5746224d871e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:58.661256 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f638665-4e19-4c45-b173-5746224d871e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:58.664090 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f638665-4e19-4c45-b173-5746224d871e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:58.667213 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f638665-4e19-4c45-b173-5746224d871e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:58.670851 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f638665-4e19-4c45-b173-5746224d871e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:58.848106 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7f638665-4e19-4c45-b173-5746224d871e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:58.858864 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7f638665-4e19-4c45-b173-5746224d871e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:58.861106 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7f638665-4e19-4c45-b173-5746224d871e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:23:58.862922 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7f638665-4e19-4c45-b173-5746224d871e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.229727 Sep 09 23:23:58.879199 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 180/380] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:23:58 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:23:59.890749 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a3d1da7a-a5a9-4e6b-9216-7579384132fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:23:59.892173 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a3d1da7a-a5a9-4e6b-9216-7579384132fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:23:59.899134 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a3d1da7a-a5a9-4e6b-9216-7579384132fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:59.899931 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a3d1da7a-a5a9-4e6b-9216-7579384132fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:59.901147 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a3d1da7a-a5a9-4e6b-9216-7579384132fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:23:59.902181 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a3d1da7a-a5a9-4e6b-9216-7579384132fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:23:59.902912 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a3d1da7a-a5a9-4e6b-9216-7579384132fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:23:59.903661 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a3d1da7a-a5a9-4e6b-9216-7579384132fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:00.056134 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a3d1da7a-a5a9-4e6b-9216-7579384132fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:00.066658 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a3d1da7a-a5a9-4e6b-9216-7579384132fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:00.068297 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a3d1da7a-a5a9-4e6b-9216-7579384132fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:00.069598 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a3d1da7a-a5a9-4e6b-9216-7579384132fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.182935 Sep 09 23:24:00.075111 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 201/381] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:23:59 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:01.096261 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-f40a7f0f-659e-4869-8633-6df168e45585 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:01.096862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-f40a7f0f-659e-4869-8633-6df168e45585 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:01.103350 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f40a7f0f-659e-4869-8633-6df168e45585 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:01.103846 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f40a7f0f-659e-4869-8633-6df168e45585 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:01.104283 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f40a7f0f-659e-4869-8633-6df168e45585 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:01.104966 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f40a7f0f-659e-4869-8633-6df168e45585 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:01.105421 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f40a7f0f-659e-4869-8633-6df168e45585 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:01.105846 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f40a7f0f-659e-4869-8633-6df168e45585 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:01.234421 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-f40a7f0f-659e-4869-8633-6df168e45585 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:01.243919 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-f40a7f0f-659e-4869-8633-6df168e45585 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:01.245414 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-f40a7f0f-659e-4869-8633-6df168e45585 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:01.246695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-f40a7f0f-659e-4869-8633-6df168e45585 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.154256 Sep 09 23:24:01.247554 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 181/382] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:01 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:02.272642 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f3762a56-4975-414f-a7c8-9d96357874cf tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:02.273249 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f3762a56-4975-414f-a7c8-9d96357874cf tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:02.279981 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f3762a56-4975-414f-a7c8-9d96357874cf tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:02.280463 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f3762a56-4975-414f-a7c8-9d96357874cf tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:02.280901 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f3762a56-4975-414f-a7c8-9d96357874cf tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:02.281586 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f3762a56-4975-414f-a7c8-9d96357874cf tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:02.282039 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f3762a56-4975-414f-a7c8-9d96357874cf tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:02.282503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f3762a56-4975-414f-a7c8-9d96357874cf tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:02.407001 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f3762a56-4975-414f-a7c8-9d96357874cf tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:02.410544 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:24:02.415638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f3762a56-4975-414f-a7c8-9d96357874cf tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:02.418133 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f3762a56-4975-414f-a7c8-9d96357874cf tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:02.419333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f3762a56-4975-414f-a7c8-9d96357874cf tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.150617 Sep 09 23:24:02.421683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 202/383] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:02 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:03.445511 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ff8dd3db-cf27-4b35-9cbb-dd2e2c8b0ff4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:03.446771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ff8dd3db-cf27-4b35-9cbb-dd2e2c8b0ff4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:03.454380 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ff8dd3db-cf27-4b35-9cbb-dd2e2c8b0ff4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:03.455002 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ff8dd3db-cf27-4b35-9cbb-dd2e2c8b0ff4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:03.455444 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ff8dd3db-cf27-4b35-9cbb-dd2e2c8b0ff4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:03.456151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ff8dd3db-cf27-4b35-9cbb-dd2e2c8b0ff4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:03.456609 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ff8dd3db-cf27-4b35-9cbb-dd2e2c8b0ff4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:03.457034 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ff8dd3db-cf27-4b35-9cbb-dd2e2c8b0ff4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:03.618026 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ff8dd3db-cf27-4b35-9cbb-dd2e2c8b0ff4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:03.628058 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ff8dd3db-cf27-4b35-9cbb-dd2e2c8b0ff4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:03.629519 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ff8dd3db-cf27-4b35-9cbb-dd2e2c8b0ff4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:03.631072 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ff8dd3db-cf27-4b35-9cbb-dd2e2c8b0ff4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.190085 Sep 09 23:24:03.642894 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 182/384] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:03 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:24:04.659491 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a240ca56-59b6-452a-9a0c-754e8a53bdff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:04.661252 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a240ca56-59b6-452a-9a0c-754e8a53bdff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:04.669486 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a240ca56-59b6-452a-9a0c-754e8a53bdff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:04.670532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a240ca56-59b6-452a-9a0c-754e8a53bdff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:04.671238 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a240ca56-59b6-452a-9a0c-754e8a53bdff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:04.673053 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a240ca56-59b6-452a-9a0c-754e8a53bdff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:04.673780 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a240ca56-59b6-452a-9a0c-754e8a53bdff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:04.674717 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a240ca56-59b6-452a-9a0c-754e8a53bdff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:04.850079 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a240ca56-59b6-452a-9a0c-754e8a53bdff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:04.859591 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a240ca56-59b6-452a-9a0c-754e8a53bdff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:04.861248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a240ca56-59b6-452a-9a0c-754e8a53bdff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:04.863571 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a240ca56-59b6-452a-9a0c-754e8a53bdff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.207560 Sep 09 23:24:04.869039 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 203/385] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:04 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:05.891585 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c16e535e-8226-4b33-96f9-8252f71e49fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:05.892288 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c16e535e-8226-4b33-96f9-8252f71e49fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:05.898744 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c16e535e-8226-4b33-96f9-8252f71e49fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:05.899227 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c16e535e-8226-4b33-96f9-8252f71e49fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:05.899662 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c16e535e-8226-4b33-96f9-8252f71e49fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:05.900347 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c16e535e-8226-4b33-96f9-8252f71e49fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:05.900799 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c16e535e-8226-4b33-96f9-8252f71e49fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:05.901223 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c16e535e-8226-4b33-96f9-8252f71e49fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:05.903804 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=100 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:24:06.030203 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c16e535e-8226-4b33-96f9-8252f71e49fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:06.038429 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c16e535e-8226-4b33-96f9-8252f71e49fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:06.039888 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c16e535e-8226-4b33-96f9-8252f71e49fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:06.041047 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c16e535e-8226-4b33-96f9-8252f71e49fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.153300 Sep 09 23:24:06.041659 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 183/386] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:05 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:07.067421 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f9b050f0-c5f3-4251-9afa-9b8dca262827 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:07.068026 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f9b050f0-c5f3-4251-9afa-9b8dca262827 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:07.074802 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f9b050f0-c5f3-4251-9afa-9b8dca262827 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:07.075288 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f9b050f0-c5f3-4251-9afa-9b8dca262827 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:07.075728 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f9b050f0-c5f3-4251-9afa-9b8dca262827 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:07.076425 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f9b050f0-c5f3-4251-9afa-9b8dca262827 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:07.076883 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f9b050f0-c5f3-4251-9afa-9b8dca262827 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:07.077308 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f9b050f0-c5f3-4251-9afa-9b8dca262827 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:07.211539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f9b050f0-c5f3-4251-9afa-9b8dca262827 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:07.220369 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f9b050f0-c5f3-4251-9afa-9b8dca262827 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:07.221832 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f9b050f0-c5f3-4251-9afa-9b8dca262827 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:07.223133 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f9b050f0-c5f3-4251-9afa-9b8dca262827 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.159552 Sep 09 23:24:07.224058 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 204/387] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:07 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:08.251959 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a3e3dd60-a909-4d14-9abd-39ebc201916e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:08.252754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a3e3dd60-a909-4d14-9abd-39ebc201916e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:08.259379 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3e3dd60-a909-4d14-9abd-39ebc201916e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:08.260530 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3e3dd60-a909-4d14-9abd-39ebc201916e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:08.261135 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3e3dd60-a909-4d14-9abd-39ebc201916e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:08.261835 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3e3dd60-a909-4d14-9abd-39ebc201916e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:08.262389 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3e3dd60-a909-4d14-9abd-39ebc201916e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:08.262887 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a3e3dd60-a909-4d14-9abd-39ebc201916e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:08.463690 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a3e3dd60-a909-4d14-9abd-39ebc201916e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:08.479405 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a3e3dd60-a909-4d14-9abd-39ebc201916e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:08.481974 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a3e3dd60-a909-4d14-9abd-39ebc201916e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:08.483859 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a3e3dd60-a909-4d14-9abd-39ebc201916e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.236139 Sep 09 23:24:08.485330 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 184/388] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:08 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:09.515085 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5dbe21fc-b71f-41cc-a43d-399aa96e7f21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:09.516147 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5dbe21fc-b71f-41cc-a43d-399aa96e7f21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:09.523293 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5dbe21fc-b71f-41cc-a43d-399aa96e7f21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:09.523910 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5dbe21fc-b71f-41cc-a43d-399aa96e7f21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:09.524441 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5dbe21fc-b71f-41cc-a43d-399aa96e7f21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:09.525244 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5dbe21fc-b71f-41cc-a43d-399aa96e7f21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:09.526771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5dbe21fc-b71f-41cc-a43d-399aa96e7f21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:09.527486 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5dbe21fc-b71f-41cc-a43d-399aa96e7f21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:09.683890 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5dbe21fc-b71f-41cc-a43d-399aa96e7f21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:09.693260 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5dbe21fc-b71f-41cc-a43d-399aa96e7f21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:09.695278 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5dbe21fc-b71f-41cc-a43d-399aa96e7f21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:09.696713 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5dbe21fc-b71f-41cc-a43d-399aa96e7f21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.185539 Sep 09 23:24:09.697458 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 205/389] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:09 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:10.733443 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-6c748178-fb68-49d0-8955-e4b3c1f96baa tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:10.735045 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-6c748178-fb68-49d0-8955-e4b3c1f96baa tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:10.742411 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6c748178-fb68-49d0-8955-e4b3c1f96baa tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:10.743366 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6c748178-fb68-49d0-8955-e4b3c1f96baa tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:10.744686 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6c748178-fb68-49d0-8955-e4b3c1f96baa tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:10.745568 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6c748178-fb68-49d0-8955-e4b3c1f96baa tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:10.746218 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6c748178-fb68-49d0-8955-e4b3c1f96baa tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:10.746781 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6c748178-fb68-49d0-8955-e4b3c1f96baa tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:10.904321 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-6c748178-fb68-49d0-8955-e4b3c1f96baa tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:10.914193 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-6c748178-fb68-49d0-8955-e4b3c1f96baa tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:10.916896 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-6c748178-fb68-49d0-8955-e4b3c1f96baa tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:10.918499 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-6c748178-fb68-49d0-8955-e4b3c1f96baa tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.190500 Sep 09 23:24:10.919068 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 185/390] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:10 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:11.775593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d8a9ab52-2d35-4aa3-9a21-a8da1f4712c1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:11.776410 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d8a9ab52-2d35-4aa3-9a21-a8da1f4712c1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:11.783178 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d8a9ab52-2d35-4aa3-9a21-a8da1f4712c1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:11.783779 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d8a9ab52-2d35-4aa3-9a21-a8da1f4712c1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:11.784917 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d8a9ab52-2d35-4aa3-9a21-a8da1f4712c1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:11.786306 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d8a9ab52-2d35-4aa3-9a21-a8da1f4712c1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:11.787354 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d8a9ab52-2d35-4aa3-9a21-a8da1f4712c1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:11.788256 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d8a9ab52-2d35-4aa3-9a21-a8da1f4712c1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:11.949556 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e8220444-acb6-4fa4-8f80-a394a917d9de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:11.951874 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e8220444-acb6-4fa4-8f80-a394a917d9de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:11.969524 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e8220444-acb6-4fa4-8f80-a394a917d9de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:11.970607 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e8220444-acb6-4fa4-8f80-a394a917d9de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:11.974225 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e8220444-acb6-4fa4-8f80-a394a917d9de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:11.974225 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e8220444-acb6-4fa4-8f80-a394a917d9de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:11.974225 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e8220444-acb6-4fa4-8f80-a394a917d9de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:11.974225 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e8220444-acb6-4fa4-8f80-a394a917d9de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:11.986541 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-d8a9ab52-2d35-4aa3-9a21-a8da1f4712c1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lazy-loading 'services' on Instance uuid f3fdcb60-b9f8-44ec-af74-562b06e49760 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:24:12.288138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d8a9ab52-2d35-4aa3-9a21-a8da1f4712c1 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760/os-volume_attachments/caff01b0-7c04-4901-95b7-2ce9e42d3942" status: 202 len: 0 microversion: 2.1 time: 0.518022 Sep 09 23:24:12.288650 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 206/391] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 23:24:11 2022] DELETE /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760/os-volume_attachments/caff01b0-7c04-4901-95b7-2ce9e42d3942 => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:24:12.493315 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e8220444-acb6-4fa4-8f80-a394a917d9de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:12.504419 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e8220444-acb6-4fa4-8f80-a394a917d9de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:12.506587 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e8220444-acb6-4fa4-8f80-a394a917d9de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:12.508001 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e8220444-acb6-4fa4-8f80-a394a917d9de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.566852 Sep 09 23:24:12.509093 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 186/392] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:11 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:24:13.537919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-de095663-3435-4219-a1a0-d9562dd47def tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:13.539433 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-de095663-3435-4219-a1a0-d9562dd47def tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:13.547204 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-de095663-3435-4219-a1a0-d9562dd47def tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:13.547817 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-de095663-3435-4219-a1a0-d9562dd47def tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:13.548285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-de095663-3435-4219-a1a0-d9562dd47def tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:13.548982 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-de095663-3435-4219-a1a0-d9562dd47def tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:13.549620 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-de095663-3435-4219-a1a0-d9562dd47def tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:13.550226 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-de095663-3435-4219-a1a0-d9562dd47def tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:13.694572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-de095663-3435-4219-a1a0-d9562dd47def tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:13.702830 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-de095663-3435-4219-a1a0-d9562dd47def tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:13.704346 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-de095663-3435-4219-a1a0-d9562dd47def tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:13.705500 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-de095663-3435-4219-a1a0-d9562dd47def tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.172715 Sep 09 23:24:13.706050 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 207/393] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:13 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:14.504773 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-f6c22f77-dfeb-4575-b812-1f35bf15c6e8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:14.505280 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-f6c22f77-dfeb-4575-b812-1f35bf15c6e8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:14.512579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f6c22f77-dfeb-4575-b812-1f35bf15c6e8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:14.513063 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f6c22f77-dfeb-4575-b812-1f35bf15c6e8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:14.513500 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f6c22f77-dfeb-4575-b812-1f35bf15c6e8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:14.514201 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f6c22f77-dfeb-4575-b812-1f35bf15c6e8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:14.514676 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f6c22f77-dfeb-4575-b812-1f35bf15c6e8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:14.519856 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f6c22f77-dfeb-4575-b812-1f35bf15c6e8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:14.541044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-f6c22f77-dfeb-4575-b812-1f35bf15c6e8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Going to try to terminate instance {{(pid=121058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:24:14.731737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e2f55271-fa61-496e-9752-de433ba8d507 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:14.732601 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e2f55271-fa61-496e-9752-de433ba8d507 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:14.735060 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=28 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:24:14.739724 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e2f55271-fa61-496e-9752-de433ba8d507 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:14.740195 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e2f55271-fa61-496e-9752-de433ba8d507 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:14.740633 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e2f55271-fa61-496e-9752-de433ba8d507 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:14.741311 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e2f55271-fa61-496e-9752-de433ba8d507 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:14.741757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e2f55271-fa61-496e-9752-de433ba8d507 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:14.742175 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e2f55271-fa61-496e-9752-de433ba8d507 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:14.830926 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-f6c22f77-dfeb-4575-b812-1f35bf15c6e8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 204 len: 0 microversion: 2.1 time: 0.329879 Sep 09 23:24:14.831610 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 187/394] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:24:14 2022] DELETE /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:24:14.844815 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c5076e27-4a8f-4b7f-9c9a-e4da162beb8e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:14.845640 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c5076e27-4a8f-4b7f-9c9a-e4da162beb8e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:14.858749 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c5076e27-4a8f-4b7f-9c9a-e4da162beb8e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:14.859140 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c5076e27-4a8f-4b7f-9c9a-e4da162beb8e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:14.859577 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c5076e27-4a8f-4b7f-9c9a-e4da162beb8e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:14.860400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c5076e27-4a8f-4b7f-9c9a-e4da162beb8e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:14.860721 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c5076e27-4a8f-4b7f-9c9a-e4da162beb8e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:14.861137 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c5076e27-4a8f-4b7f-9c9a-e4da162beb8e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:14.898996 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e2f55271-fa61-496e-9752-de433ba8d507 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:14.907670 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e2f55271-fa61-496e-9752-de433ba8d507 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:14.909387 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e2f55271-fa61-496e-9752-de433ba8d507 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:14.910862 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e2f55271-fa61-496e-9752-de433ba8d507 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.183273 Sep 09 23:24:14.911421 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 208/395] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:14 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:24:15.018301 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c5076e27-4a8f-4b7f-9c9a-e4da162beb8e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:15.026760 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c5076e27-4a8f-4b7f-9c9a-e4da162beb8e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1514 microversion: 2.1 time: 0.186101 Sep 09 23:24:15.027323 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 188/396] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:24:14 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:24:15.938470 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4a29a1a7-6051-461e-b0c5-4e967868f08b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:15.939085 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4a29a1a7-6051-461e-b0c5-4e967868f08b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:15.945541 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a29a1a7-6051-461e-b0c5-4e967868f08b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:15.946022 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a29a1a7-6051-461e-b0c5-4e967868f08b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:15.946487 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a29a1a7-6051-461e-b0c5-4e967868f08b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:15.947177 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a29a1a7-6051-461e-b0c5-4e967868f08b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:15.948218 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a29a1a7-6051-461e-b0c5-4e967868f08b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:15.948654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a29a1a7-6051-461e-b0c5-4e967868f08b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:16.050815 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-642d36a4-3131-497a-9df2-c7d55c579e7e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:16.051543 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-642d36a4-3131-497a-9df2-c7d55c579e7e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:16.054138 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:24:16.059687 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-642d36a4-3131-497a-9df2-c7d55c579e7e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:16.060190 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-642d36a4-3131-497a-9df2-c7d55c579e7e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:16.060632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-642d36a4-3131-497a-9df2-c7d55c579e7e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:16.061337 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-642d36a4-3131-497a-9df2-c7d55c579e7e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:16.061810 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-642d36a4-3131-497a-9df2-c7d55c579e7e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:16.062218 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-642d36a4-3131-497a-9df2-c7d55c579e7e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:16.082496 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4a29a1a7-6051-461e-b0c5-4e967868f08b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:16.091144 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4a29a1a7-6051-461e-b0c5-4e967868f08b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:16.094161 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4a29a1a7-6051-461e-b0c5-4e967868f08b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:16.094161 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4a29a1a7-6051-461e-b0c5-4e967868f08b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.159350 Sep 09 23:24:16.094736 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 209/397] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:15 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:16.197208 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-642d36a4-3131-497a-9df2-c7d55c579e7e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:16.205318 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-642d36a4-3131-497a-9df2-c7d55c579e7e tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1514 microversion: 2.1 time: 0.158468 Sep 09 23:24:16.205874 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 189/398] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:24:16 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:24:17.123244 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b08ccbb0-05bc-40aa-ac1d-d0aaaf58b83a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:17.125672 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b08ccbb0-05bc-40aa-ac1d-d0aaaf58b83a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:17.130533 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b08ccbb0-05bc-40aa-ac1d-d0aaaf58b83a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:17.131045 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b08ccbb0-05bc-40aa-ac1d-d0aaaf58b83a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:17.131660 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b08ccbb0-05bc-40aa-ac1d-d0aaaf58b83a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:17.132356 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b08ccbb0-05bc-40aa-ac1d-d0aaaf58b83a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:17.132822 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b08ccbb0-05bc-40aa-ac1d-d0aaaf58b83a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:17.133246 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b08ccbb0-05bc-40aa-ac1d-d0aaaf58b83a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:17.229466 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-40876751-947b-4d03-b3fb-6e287907bba8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:17.230104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-40876751-947b-4d03-b3fb-6e287907bba8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:17.239101 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-40876751-947b-4d03-b3fb-6e287907bba8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:17.239588 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-40876751-947b-4d03-b3fb-6e287907bba8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:17.240023 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-40876751-947b-4d03-b3fb-6e287907bba8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:17.240726 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-40876751-947b-4d03-b3fb-6e287907bba8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:17.241180 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-40876751-947b-4d03-b3fb-6e287907bba8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:17.241743 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-40876751-947b-4d03-b3fb-6e287907bba8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:17.271585 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b08ccbb0-05bc-40aa-ac1d-d0aaaf58b83a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:17.282949 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b08ccbb0-05bc-40aa-ac1d-d0aaaf58b83a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:17.284688 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b08ccbb0-05bc-40aa-ac1d-d0aaaf58b83a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:17.285970 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b08ccbb0-05bc-40aa-ac1d-d0aaaf58b83a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.167780 Sep 09 23:24:17.299382 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 210/399] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:17 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:17.349835 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-40876751-947b-4d03-b3fb-6e287907bba8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:17.359503 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-40876751-947b-4d03-b3fb-6e287907bba8 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1472 microversion: 2.1 time: 0.135071 Sep 09 23:24:17.360334 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 190/400] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:24:17 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1472 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:24:17.426104 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-68e5d568-2c70-475c-925f-cc553558c050 req-13950809-fe2b-446e-a26c-2342fe48ea52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fdcb60-b9f8-44ec-af74-562b06e49760", "name": "network-vif-deleted", "tag": "3ac8b0ba-fec9-49ec-81bc-e839b52e5405"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:24:17.436697 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-68e5d568-2c70-475c-925f-cc553558c050 req-13950809-fe2b-446e-a26c-2342fe48ea52 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:17.437404 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-68e5d568-2c70-475c-925f-cc553558c050 req-13950809-fe2b-446e-a26c-2342fe48ea52 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:17.437836 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-68e5d568-2c70-475c-925f-cc553558c050 req-13950809-fe2b-446e-a26c-2342fe48ea52 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:17.449796 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-68e5d568-2c70-475c-925f-cc553558c050 req-13950809-fe2b-446e-a26c-2342fe48ea52 service nova] Creating event network-vif-deleted:3ac8b0ba-fec9-49ec-81bc-e839b52e5405 for instance f3fdcb60-b9f8-44ec-af74-562b06e49760 on hv-cinder-85032 Sep 09 23:24:17.455073 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-68e5d568-2c70-475c-925f-cc553558c050 req-13950809-fe2b-446e-a26c-2342fe48ea52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032705 Sep 09 23:24:17.455672 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 211/401] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:24:18.313985 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3a6a6402-1443-4552-b2b2-b1bfaaf7baba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:18.314620 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3a6a6402-1443-4552-b2b2-b1bfaaf7baba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:18.321224 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3a6a6402-1443-4552-b2b2-b1bfaaf7baba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:18.321780 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3a6a6402-1443-4552-b2b2-b1bfaaf7baba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:18.322290 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3a6a6402-1443-4552-b2b2-b1bfaaf7baba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:18.323099 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3a6a6402-1443-4552-b2b2-b1bfaaf7baba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:18.323617 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3a6a6402-1443-4552-b2b2-b1bfaaf7baba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:18.324049 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3a6a6402-1443-4552-b2b2-b1bfaaf7baba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:18.383595 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-63768b19-da29-4bf9-aec0-ba7be1e46cd9 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:18.384212 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-63768b19-da29-4bf9-aec0-ba7be1e46cd9 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:18.390852 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-63768b19-da29-4bf9-aec0-ba7be1e46cd9 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:18.391419 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-63768b19-da29-4bf9-aec0-ba7be1e46cd9 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:18.391921 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-63768b19-da29-4bf9-aec0-ba7be1e46cd9 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:18.392685 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-63768b19-da29-4bf9-aec0-ba7be1e46cd9 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:18.393264 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-63768b19-da29-4bf9-aec0-ba7be1e46cd9 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:18.393750 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-63768b19-da29-4bf9-aec0-ba7be1e46cd9 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:18.433320 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-63768b19-da29-4bf9-aec0-ba7be1e46cd9 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:18.433890 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-63768b19-da29-4bf9-aec0-ba7be1e46cd9 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:18.434397 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-63768b19-da29-4bf9-aec0-ba7be1e46cd9 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:18.434846 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-63768b19-da29-4bf9-aec0-ba7be1e46cd9 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lazy-loading 'fault' on Instance uuid f3fdcb60-b9f8-44ec-af74-562b06e49760 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:24:18.468843 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3a6a6402-1443-4552-b2b2-b1bfaaf7baba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:18.476137 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-63768b19-da29-4bf9-aec0-ba7be1e46cd9 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72467431e40c491cad192b06be494175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31116d92493460793d41ba2a6a166e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:18.477379 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3a6a6402-1443-4552-b2b2-b1bfaaf7baba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:18.479050 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3a6a6402-1443-4552-b2b2-b1bfaaf7baba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:18.480237 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3a6a6402-1443-4552-b2b2-b1bfaaf7baba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1738 microversion: 2.20 time: 0.170176 Sep 09 23:24:18.481106 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 191/402] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:18 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:18.485512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-63768b19-da29-4bf9-aec0-ba7be1e46cd9 tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 200 len: 1309 microversion: 2.1 time: 0.106699 Sep 09 23:24:18.486075 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 212/403] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:24:18 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:24:19.510714 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-aede31f0-f008-4b7a-9438-f87de7d87bfd tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:19.512498 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7a8e63fa-8fd3-4a11-a68d-91dc731f797e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:19.513162 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7a8e63fa-8fd3-4a11-a68d-91dc731f797e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:19.513403 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-aede31f0-f008-4b7a-9438-f87de7d87bfd tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] [instance: f3fdcb60-b9f8-44ec-af74-562b06e49760] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:19.520137 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aede31f0-f008-4b7a-9438-f87de7d87bfd tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:19.521216 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aede31f0-f008-4b7a-9438-f87de7d87bfd tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:19.521781 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aede31f0-f008-4b7a-9438-f87de7d87bfd tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:19.522949 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aede31f0-f008-4b7a-9438-f87de7d87bfd tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:19.523043 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7a8e63fa-8fd3-4a11-a68d-91dc731f797e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:19.523509 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7a8e63fa-8fd3-4a11-a68d-91dc731f797e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:19.523658 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aede31f0-f008-4b7a-9438-f87de7d87bfd tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:19.523947 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7a8e63fa-8fd3-4a11-a68d-91dc731f797e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:19.524276 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aede31f0-f008-4b7a-9438-f87de7d87bfd tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:19.524649 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7a8e63fa-8fd3-4a11-a68d-91dc731f797e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:19.525109 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7a8e63fa-8fd3-4a11-a68d-91dc731f797e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:19.526090 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7a8e63fa-8fd3-4a11-a68d-91dc731f797e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:19.544219 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-aede31f0-f008-4b7a-9438-f87de7d87bfd tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] HTTP exception thrown: Instance f3fdcb60-b9f8-44ec-af74-562b06e49760 could not be found. Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-aede31f0-f008-4b7a-9438-f87de7d87bfd tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Request method failure captured: Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 HTTP/1.1 Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8qNtAt_LXpWwBALmeZAEkpflOHx2rr5GkME6RcMUK1AmOJNB7cMxjA4SvO1BgyQgxYHU9CJ30V-c999KbMDhlC1upRVFudEpke59scVA4FV2ScHZfJMLd2HAYi0NUlaq8ir_EC7_TUw5JQy6u8xphatiXds16BOgb0gRNN6StBHE1U Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: c31116d92493460793d41ba2a6a166e0 Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1875035980 Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:24:19.546385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:24:19.547683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c31116d92493460793d41ba2a6a166e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c31116d92493460793d41ba2a6a166e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c31116d92493460793d41ba2a6a166e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c31116d92493460793d41ba2a6a166e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:24:19.547683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-VolumesSnapshotTestJSON-1875035980 Sep 09 23:24:19.547683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: c31116d92493460793d41ba2a6a166e0 Sep 09 23:24:19.547683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1875035980 Sep 09 23:24:19.547683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-VolumesSnapshotTestJSON-1875035980-project Sep 09 23:24:19.547683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:24:19.547683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:24:19.547683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 72467431e40c491cad192b06be494175 Sep 09 23:24:19.547683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-VolumesSnapshotTestJSON-1875035980-project Sep 09 23:24:19.547683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:24:19.547683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance f3fdcb60-b9f8-44ec-af74-562b06e49760 could not be found. Sep 09 23:24:19.547683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': 'f3fdcb60-b9f8-44ec-af74-562b06e49760'} Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fdcb60-b9f8-44ec-af74-562b06e49760 could not be found. Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:24:19.548738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fdcb60-b9f8-44ec-af74-562b06e49760 could not be found. Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fdcb60-b9f8-44ec-af74-562b06e49760 could not be found. Sep 09 23:24:19.550118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:24:19.551176 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-aede31f0-f008-4b7a-9438-f87de7d87bfd tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] Returning 404 to user: Instance f3fdcb60-b9f8-44ec-af74-562b06e49760 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:24:19.551176 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-aede31f0-f008-4b7a-9438-f87de7d87bfd tempest-VolumesSnapshotTestJSON-1875035980 tempest-VolumesSnapshotTestJSON-1875035980-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760" status: 404 len: 111 microversion: 2.1 time: 0.041874 Sep 09 23:24:19.551176 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 213/404] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:24:19 2022] GET /compute/v2.1/servers/f3fdcb60-b9f8-44ec-af74-562b06e49760 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:24:19.693101 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7a8e63fa-8fd3-4a11-a68d-91dc731f797e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:19.702404 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7a8e63fa-8fd3-4a11-a68d-91dc731f797e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:19.703871 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7a8e63fa-8fd3-4a11-a68d-91dc731f797e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:19.705038 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7a8e63fa-8fd3-4a11-a68d-91dc731f797e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1738 microversion: 2.20 time: 0.200477 Sep 09 23:24:19.706654 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 192/405] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:19 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:20.735400 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-301dbc24-f78a-4826-a705-062e0041cd0e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:20.735892 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-301dbc24-f78a-4826-a705-062e0041cd0e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:20.742456 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-301dbc24-f78a-4826-a705-062e0041cd0e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:20.743004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-301dbc24-f78a-4826-a705-062e0041cd0e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:20.743445 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-301dbc24-f78a-4826-a705-062e0041cd0e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:20.744877 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-301dbc24-f78a-4826-a705-062e0041cd0e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:20.745764 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-301dbc24-f78a-4826-a705-062e0041cd0e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:20.746208 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-301dbc24-f78a-4826-a705-062e0041cd0e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:20.885890 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-301dbc24-f78a-4826-a705-062e0041cd0e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:20.894117 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-301dbc24-f78a-4826-a705-062e0041cd0e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:20.895579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-301dbc24-f78a-4826-a705-062e0041cd0e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:20.896715 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-301dbc24-f78a-4826-a705-062e0041cd0e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1733 microversion: 2.20 time: 0.165799 Sep 09 23:24:20.897267 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 214/406] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:20 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:21.936678 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-4df6d1f3-7618-413f-aa28-567a307c5115 req-22320f87-cd0b-41d8-b168-3c8ee28ca67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a8b2e1-79be-4c0d-b316-94c95ae04638", "name": "network-vif-plugged", "status": "completed", "tag": "a8c73f48-9a44-48f9-9123-64c486486e8b"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:24:21.938103 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b1972763-64b9-405a-88e6-fe4c307fb999 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:21.940708 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b1972763-64b9-405a-88e6-fe4c307fb999 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:21.958630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-4df6d1f3-7618-413f-aa28-567a307c5115 req-22320f87-cd0b-41d8-b168-3c8ee28ca67f service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:21.959018 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1972763-64b9-405a-88e6-fe4c307fb999 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:21.959716 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1972763-64b9-405a-88e6-fe4c307fb999 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:21.960610 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1972763-64b9-405a-88e6-fe4c307fb999 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:21.961540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1972763-64b9-405a-88e6-fe4c307fb999 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:21.962627 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-4df6d1f3-7618-413f-aa28-567a307c5115 req-22320f87-cd0b-41d8-b168-3c8ee28ca67f service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:21.963208 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1972763-64b9-405a-88e6-fe4c307fb999 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:21.963661 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-4df6d1f3-7618-413f-aa28-567a307c5115 req-22320f87-cd0b-41d8-b168-3c8ee28ca67f service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:21.964154 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1972763-64b9-405a-88e6-fe4c307fb999 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:21.996872 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-4df6d1f3-7618-413f-aa28-567a307c5115 req-22320f87-cd0b-41d8-b168-3c8ee28ca67f service nova] Creating event network-vif-plugged:a8c73f48-9a44-48f9-9123-64c486486e8b for instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 on hv-cinder-85032 Sep 09 23:24:22.014612 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-4df6d1f3-7618-413f-aa28-567a307c5115 req-22320f87-cd0b-41d8-b168-3c8ee28ca67f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085179 Sep 09 23:24:22.015668 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 215/407] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:24:22.145967 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b1972763-64b9-405a-88e6-fe4c307fb999 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:22.154589 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b1972763-64b9-405a-88e6-fe4c307fb999 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:22.156298 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b1972763-64b9-405a-88e6-fe4c307fb999 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:22.157752 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b1972763-64b9-405a-88e6-fe4c307fb999 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1733 microversion: 2.20 time: 0.237595 Sep 09 23:24:22.158316 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 193/408] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:21 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1733 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:23.190522 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-59bf4141-490f-43ca-b702-1dc1ee3fb27e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:23.224427 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-59bf4141-490f-43ca-b702-1dc1ee3fb27e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:23.224427 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-59bf4141-490f-43ca-b702-1dc1ee3fb27e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:23.224427 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-59bf4141-490f-43ca-b702-1dc1ee3fb27e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:23.224427 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-59bf4141-490f-43ca-b702-1dc1ee3fb27e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:23.224773 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-59bf4141-490f-43ca-b702-1dc1ee3fb27e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:23.224773 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-59bf4141-490f-43ca-b702-1dc1ee3fb27e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:23.224773 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-59bf4141-490f-43ca-b702-1dc1ee3fb27e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:23.363952 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-59bf4141-490f-43ca-b702-1dc1ee3fb27e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:23.373289 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-59bf4141-490f-43ca-b702-1dc1ee3fb27e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:23.375155 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-59bf4141-490f-43ca-b702-1dc1ee3fb27e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:23.376614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-59bf4141-490f-43ca-b702-1dc1ee3fb27e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1733 microversion: 2.20 time: 0.190511 Sep 09 23:24:23.377767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 216/409] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:23 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1733 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:24.404399 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0c6fab2e-94c0-488a-ba98-906b0d654421 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:24.405136 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0c6fab2e-94c0-488a-ba98-906b0d654421 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:24.412051 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c6fab2e-94c0-488a-ba98-906b0d654421 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:24.412540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c6fab2e-94c0-488a-ba98-906b0d654421 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:24.412976 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c6fab2e-94c0-488a-ba98-906b0d654421 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:24.413678 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c6fab2e-94c0-488a-ba98-906b0d654421 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:24.414138 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c6fab2e-94c0-488a-ba98-906b0d654421 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:24.414596 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c6fab2e-94c0-488a-ba98-906b0d654421 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:24.561530 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0c6fab2e-94c0-488a-ba98-906b0d654421 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:24.561530 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0c6fab2e-94c0-488a-ba98-906b0d654421 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:24.561785 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0c6fab2e-94c0-488a-ba98-906b0d654421 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:24.561785 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0c6fab2e-94c0-488a-ba98-906b0d654421 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1733 microversion: 2.20 time: 0.162035 Sep 09 23:24:24.562149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 194/410] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:24 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:24:25.588319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-53c10dd5-aba3-495d-8ac1-47d9f143e13b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:25.589858 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-53c10dd5-aba3-495d-8ac1-47d9f143e13b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:25.599257 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53c10dd5-aba3-495d-8ac1-47d9f143e13b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:25.599756 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53c10dd5-aba3-495d-8ac1-47d9f143e13b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:25.600385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53c10dd5-aba3-495d-8ac1-47d9f143e13b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:25.601241 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53c10dd5-aba3-495d-8ac1-47d9f143e13b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:25.601701 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53c10dd5-aba3-495d-8ac1-47d9f143e13b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:25.602131 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53c10dd5-aba3-495d-8ac1-47d9f143e13b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:25.765147 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-53c10dd5-aba3-495d-8ac1-47d9f143e13b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:25.775977 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-53c10dd5-aba3-495d-8ac1-47d9f143e13b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:25.785398 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-53c10dd5-aba3-495d-8ac1-47d9f143e13b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:25.787477 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-53c10dd5-aba3-495d-8ac1-47d9f143e13b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1733 microversion: 2.20 time: 0.203566 Sep 09 23:24:25.802911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 217/411] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:25 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:26.819020 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-34dd20ce-3cc3-47ac-931e-ccff1035c32c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:26.819662 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-34dd20ce-3cc3-47ac-931e-ccff1035c32c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:26.828274 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-34dd20ce-3cc3-47ac-931e-ccff1035c32c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:26.828760 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-34dd20ce-3cc3-47ac-931e-ccff1035c32c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:26.829397 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-34dd20ce-3cc3-47ac-931e-ccff1035c32c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:26.830442 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-34dd20ce-3cc3-47ac-931e-ccff1035c32c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:26.830898 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-34dd20ce-3cc3-47ac-931e-ccff1035c32c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:26.834505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-34dd20ce-3cc3-47ac-931e-ccff1035c32c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:27.001174 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-34dd20ce-3cc3-47ac-931e-ccff1035c32c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:27.010585 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-34dd20ce-3cc3-47ac-931e-ccff1035c32c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:27.012551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-34dd20ce-3cc3-47ac-931e-ccff1035c32c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:27.014254 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-34dd20ce-3cc3-47ac-931e-ccff1035c32c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1733 microversion: 2.20 time: 0.201891 Sep 09 23:24:27.014969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 195/412] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:26 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1733 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:28.045672 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-eb70a9ff-0847-4d9f-a2a5-cf847bcaf93a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:28.046175 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-eb70a9ff-0847-4d9f-a2a5-cf847bcaf93a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:28.053005 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb70a9ff-0847-4d9f-a2a5-cf847bcaf93a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:28.056688 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb70a9ff-0847-4d9f-a2a5-cf847bcaf93a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:28.057231 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb70a9ff-0847-4d9f-a2a5-cf847bcaf93a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:28.058215 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb70a9ff-0847-4d9f-a2a5-cf847bcaf93a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:28.058908 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb70a9ff-0847-4d9f-a2a5-cf847bcaf93a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:28.060026 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb70a9ff-0847-4d9f-a2a5-cf847bcaf93a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:28.208899 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-eb70a9ff-0847-4d9f-a2a5-cf847bcaf93a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:28.218577 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-eb70a9ff-0847-4d9f-a2a5-cf847bcaf93a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:28.220352 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-eb70a9ff-0847-4d9f-a2a5-cf847bcaf93a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:28.221922 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-eb70a9ff-0847-4d9f-a2a5-cf847bcaf93a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1733 microversion: 2.20 time: 0.182955 Sep 09 23:24:28.223795 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 218/413] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:28 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1733 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:29.251193 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7237e8fd-fdf9-44be-8353-245be7c11c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:29.252696 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7237e8fd-fdf9-44be-8353-245be7c11c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:29.268219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7237e8fd-fdf9-44be-8353-245be7c11c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:29.275069 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7237e8fd-fdf9-44be-8353-245be7c11c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:29.275069 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7237e8fd-fdf9-44be-8353-245be7c11c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:29.275069 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7237e8fd-fdf9-44be-8353-245be7c11c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:29.275069 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7237e8fd-fdf9-44be-8353-245be7c11c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:29.275498 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7237e8fd-fdf9-44be-8353-245be7c11c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:29.460549 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7237e8fd-fdf9-44be-8353-245be7c11c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:29.484611 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7237e8fd-fdf9-44be-8353-245be7c11c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:29.484611 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7237e8fd-fdf9-44be-8353-245be7c11c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:29.484611 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7237e8fd-fdf9-44be-8353-245be7c11c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1733 microversion: 2.20 time: 0.233732 Sep 09 23:24:29.484933 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 196/414] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:29 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1733 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:30.513838 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d4070f8b-1e67-4138-86b0-1e079299681c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:30.514478 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d4070f8b-1e67-4138-86b0-1e079299681c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:30.520473 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d4070f8b-1e67-4138-86b0-1e079299681c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:30.521908 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d4070f8b-1e67-4138-86b0-1e079299681c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:30.521908 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d4070f8b-1e67-4138-86b0-1e079299681c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:30.522677 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d4070f8b-1e67-4138-86b0-1e079299681c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:30.523139 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d4070f8b-1e67-4138-86b0-1e079299681c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:30.523567 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d4070f8b-1e67-4138-86b0-1e079299681c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:30.678635 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d4070f8b-1e67-4138-86b0-1e079299681c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:30.688766 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d4070f8b-1e67-4138-86b0-1e079299681c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:30.691506 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d4070f8b-1e67-4138-86b0-1e079299681c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:30.694127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d4070f8b-1e67-4138-86b0-1e079299681c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1733 microversion: 2.20 time: 0.185396 Sep 09 23:24:30.706887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 219/415] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:30 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1733 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:31.722893 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7f3282c8-75bd-4fa4-8b9f-b1d656f4ec83 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:31.723562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7f3282c8-75bd-4fa4-8b9f-b1d656f4ec83 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:31.730116 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f3282c8-75bd-4fa4-8b9f-b1d656f4ec83 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:31.730631 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f3282c8-75bd-4fa4-8b9f-b1d656f4ec83 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:31.731085 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f3282c8-75bd-4fa4-8b9f-b1d656f4ec83 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:31.731843 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f3282c8-75bd-4fa4-8b9f-b1d656f4ec83 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:31.732344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f3282c8-75bd-4fa4-8b9f-b1d656f4ec83 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:31.733048 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7f3282c8-75bd-4fa4-8b9f-b1d656f4ec83 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:31.884396 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7f3282c8-75bd-4fa4-8b9f-b1d656f4ec83 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:31.893390 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7f3282c8-75bd-4fa4-8b9f-b1d656f4ec83 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:31.895037 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7f3282c8-75bd-4fa4-8b9f-b1d656f4ec83 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:31.896501 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7f3282c8-75bd-4fa4-8b9f-b1d656f4ec83 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1733 microversion: 2.20 time: 0.177661 Sep 09 23:24:31.897159 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 197/416] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:31 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1733 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:32.923324 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7268ea86-397e-4398-b088-7ceaf900ff42 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:32.923880 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7268ea86-397e-4398-b088-7ceaf900ff42 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:32.930267 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7268ea86-397e-4398-b088-7ceaf900ff42 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:32.930788 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7268ea86-397e-4398-b088-7ceaf900ff42 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:32.931229 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7268ea86-397e-4398-b088-7ceaf900ff42 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:32.931923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7268ea86-397e-4398-b088-7ceaf900ff42 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:32.932385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7268ea86-397e-4398-b088-7ceaf900ff42 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:32.932839 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7268ea86-397e-4398-b088-7ceaf900ff42 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:32.950563 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:24:33.058932 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7268ea86-397e-4398-b088-7ceaf900ff42 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:33.067024 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7268ea86-397e-4398-b088-7ceaf900ff42 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:33.068497 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7268ea86-397e-4398-b088-7ceaf900ff42 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:33.069659 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7268ea86-397e-4398-b088-7ceaf900ff42 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1733 microversion: 2.20 time: 0.151064 Sep 09 23:24:33.070214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 220/417] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:32 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:33.485555 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b06e4ac0-37a0-4423-8b76-bcc0d5975efc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2dee8f47-6a63-4ba4-870e-71db6f3e12e5"}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:24:33.487896 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b06e4ac0-37a0-4423-8b76-bcc0d5975efc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:33.494101 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b06e4ac0-37a0-4423-8b76-bcc0d5975efc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:33.494620 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b06e4ac0-37a0-4423-8b76-bcc0d5975efc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:33.495056 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b06e4ac0-37a0-4423-8b76-bcc0d5975efc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:33.495739 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b06e4ac0-37a0-4423-8b76-bcc0d5975efc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:33.496188 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b06e4ac0-37a0-4423-8b76-bcc0d5975efc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:33.496608 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b06e4ac0-37a0-4423-8b76-bcc0d5975efc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:33.501033 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:24:34.097268 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-67edebd2-2a69-4257-b0ee-319de40c6f69 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:34.097882 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-67edebd2-2a69-4257-b0ee-319de40c6f69 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:34.104400 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-67edebd2-2a69-4257-b0ee-319de40c6f69 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:34.104884 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-67edebd2-2a69-4257-b0ee-319de40c6f69 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:34.105324 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-67edebd2-2a69-4257-b0ee-319de40c6f69 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:34.106052 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-67edebd2-2a69-4257-b0ee-319de40c6f69 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:34.106500 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-67edebd2-2a69-4257-b0ee-319de40c6f69 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:34.111897 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-67edebd2-2a69-4257-b0ee-319de40c6f69 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:34.239694 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-67edebd2-2a69-4257-b0ee-319de40c6f69 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:34.247703 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-67edebd2-2a69-4257-b0ee-319de40c6f69 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:34.249142 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-67edebd2-2a69-4257-b0ee-319de40c6f69 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:34.250268 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-67edebd2-2a69-4257-b0ee-319de40c6f69 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1733 microversion: 2.20 time: 0.158322 Sep 09 23:24:34.250847 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 221/418] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:34 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:24:35.276074 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f6f2f550-a4e6-42aa-b0a9-fc490d520ab8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:35.276728 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f6f2f550-a4e6-42aa-b0a9-fc490d520ab8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:35.283510 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f6f2f550-a4e6-42aa-b0a9-fc490d520ab8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:35.284038 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f6f2f550-a4e6-42aa-b0a9-fc490d520ab8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:35.284473 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f6f2f550-a4e6-42aa-b0a9-fc490d520ab8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:35.285153 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f6f2f550-a4e6-42aa-b0a9-fc490d520ab8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:35.285604 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f6f2f550-a4e6-42aa-b0a9-fc490d520ab8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:35.286025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f6f2f550-a4e6-42aa-b0a9-fc490d520ab8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:35.429094 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f6f2f550-a4e6-42aa-b0a9-fc490d520ab8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:35.437520 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f6f2f550-a4e6-42aa-b0a9-fc490d520ab8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:35.439015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f6f2f550-a4e6-42aa-b0a9-fc490d520ab8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:35.440187 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f6f2f550-a4e6-42aa-b0a9-fc490d520ab8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1733 microversion: 2.20 time: 0.168146 Sep 09 23:24:35.441216 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 222/419] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:35 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:24:35.506091 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-132bc409-9646-4147-a5d3-7cc3068bd245 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:35.506617 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-132bc409-9646-4147-a5d3-7cc3068bd245 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:35.513068 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-132bc409-9646-4147-a5d3-7cc3068bd245 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:35.513734 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-132bc409-9646-4147-a5d3-7cc3068bd245 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:35.518801 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-132bc409-9646-4147-a5d3-7cc3068bd245 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:35.519555 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-132bc409-9646-4147-a5d3-7cc3068bd245 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:35.520031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-132bc409-9646-4147-a5d3-7cc3068bd245 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:35.525264 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-132bc409-9646-4147-a5d3-7cc3068bd245 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:35.610227 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-132bc409-9646-4147-a5d3-7cc3068bd245 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lazy-loading 'services' on Instance uuid e56bd49b-8d5d-4de6-a394-2d097824a7c4 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:24:35.994844 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b06e4ac0-37a0-4423-8b76-bcc0d5975efc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "POST /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.514032 Sep 09 23:24:35.995840 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 198/420] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 23:24:33 2022] POST /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-volume_attachments => generated 194 bytes in 2516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:24:36.006782 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-132bc409-9646-4147-a5d3-7cc3068bd245 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/os-volume_attachments/ec811f49-2113-4dc1-8d33-1c36ee511f2a" status: 202 len: 0 microversion: 2.1 time: 0.504399 Sep 09 23:24:36.011907 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 223/421] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 23:24:35 2022] DELETE /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/os-volume_attachments/ec811f49-2113-4dc1-8d33-1c36ee511f2a => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 23:24:36.470708 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c54d2524-7a82-4fc4-b6b8-764eb4188cf0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:36.471198 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c54d2524-7a82-4fc4-b6b8-764eb4188cf0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:36.477477 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c54d2524-7a82-4fc4-b6b8-764eb4188cf0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:36.477959 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c54d2524-7a82-4fc4-b6b8-764eb4188cf0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:36.478414 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c54d2524-7a82-4fc4-b6b8-764eb4188cf0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:36.479115 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c54d2524-7a82-4fc4-b6b8-764eb4188cf0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:36.479572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c54d2524-7a82-4fc4-b6b8-764eb4188cf0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:36.479998 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c54d2524-7a82-4fc4-b6b8-764eb4188cf0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:36.620622 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c54d2524-7a82-4fc4-b6b8-764eb4188cf0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:36.629586 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c54d2524-7a82-4fc4-b6b8-764eb4188cf0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:36.631054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c54d2524-7a82-4fc4-b6b8-764eb4188cf0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:36.632199 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c54d2524-7a82-4fc4-b6b8-764eb4188cf0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1715 microversion: 2.20 time: 0.167155 Sep 09 23:24:36.632759 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 199/422] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:36 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1715 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:37.661025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fd26b684-84bc-495c-98c3-34cdf6be42ff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:37.661645 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-fd26b684-84bc-495c-98c3-34cdf6be42ff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:37.667825 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd26b684-84bc-495c-98c3-34cdf6be42ff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:37.668309 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd26b684-84bc-495c-98c3-34cdf6be42ff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:37.668842 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd26b684-84bc-495c-98c3-34cdf6be42ff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:37.670175 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd26b684-84bc-495c-98c3-34cdf6be42ff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:37.670661 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd26b684-84bc-495c-98c3-34cdf6be42ff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:37.671087 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd26b684-84bc-495c-98c3-34cdf6be42ff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:37.808811 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fd26b684-84bc-495c-98c3-34cdf6be42ff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:37.816910 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fd26b684-84bc-495c-98c3-34cdf6be42ff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:37.818421 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fd26b684-84bc-495c-98c3-34cdf6be42ff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:37.819576 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-fd26b684-84bc-495c-98c3-34cdf6be42ff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1715 microversion: 2.20 time: 0.163334 Sep 09 23:24:37.820133 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 224/423] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:37 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:38.845657 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9ba0004c-0071-41b8-a6bc-f8545fdfd33e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:38.846282 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9ba0004c-0071-41b8-a6bc-f8545fdfd33e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:38.852980 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ba0004c-0071-41b8-a6bc-f8545fdfd33e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:38.853467 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ba0004c-0071-41b8-a6bc-f8545fdfd33e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:38.853904 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ba0004c-0071-41b8-a6bc-f8545fdfd33e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:38.854625 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ba0004c-0071-41b8-a6bc-f8545fdfd33e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:38.855093 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ba0004c-0071-41b8-a6bc-f8545fdfd33e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:38.855524 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ba0004c-0071-41b8-a6bc-f8545fdfd33e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:38.985345 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9ba0004c-0071-41b8-a6bc-f8545fdfd33e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:38.993379 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9ba0004c-0071-41b8-a6bc-f8545fdfd33e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:38.994861 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9ba0004c-0071-41b8-a6bc-f8545fdfd33e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:38.996031 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9ba0004c-0071-41b8-a6bc-f8545fdfd33e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1718 microversion: 2.20 time: 0.154992 Sep 09 23:24:38.996598 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 200/424] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:38 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:39.025244 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-2cf8a664-989a-45f7-9abe-6e78efc1b44a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69903d8f-3493-4a24-b0d6-b69feb7320b5"}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:24:39.027640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-2cf8a664-989a-45f7-9abe-6e78efc1b44a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:39.034033 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2cf8a664-989a-45f7-9abe-6e78efc1b44a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:39.034554 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2cf8a664-989a-45f7-9abe-6e78efc1b44a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:39.034987 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2cf8a664-989a-45f7-9abe-6e78efc1b44a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:39.035673 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2cf8a664-989a-45f7-9abe-6e78efc1b44a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:39.036287 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2cf8a664-989a-45f7-9abe-6e78efc1b44a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:39.036708 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2cf8a664-989a-45f7-9abe-6e78efc1b44a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:39.914882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-e8a822a7-e050-413b-bb8b-48abbd901c39 req-fdc61f57-d5ee-4535-b900-d25185c2817d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a8b2e1-79be-4c0d-b316-94c95ae04638", "name": "network-vif-unplugged", "status": "completed", "tag": "a8c73f48-9a44-48f9-9123-64c486486e8b"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:24:39.925481 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-e8a822a7-e050-413b-bb8b-48abbd901c39 req-fdc61f57-d5ee-4535-b900-d25185c2817d service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:39.925964 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-e8a822a7-e050-413b-bb8b-48abbd901c39 req-fdc61f57-d5ee-4535-b900-d25185c2817d service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:39.926422 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-e8a822a7-e050-413b-bb8b-48abbd901c39 req-fdc61f57-d5ee-4535-b900-d25185c2817d service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:39.939134 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.compute.server_external_events [req-e8a822a7-e050-413b-bb8b-48abbd901c39 req-fdc61f57-d5ee-4535-b900-d25185c2817d service nova] Unable to find a host for instance 61a8b2e1-79be-4c0d-b316-94c95ae04638. Dropping event network-vif-unplugged {{(pid=121058) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 23:24:39.940008 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-e8a822a7-e050-413b-bb8b-48abbd901c39 req-fdc61f57-d5ee-4535-b900-d25185c2817d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029169 Sep 09 23:24:39.940602 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 201/425] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 09 23:24:39.952012 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-2cf8a664-989a-45f7-9abe-6e78efc1b44a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "POST /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.929957 Sep 09 23:24:39.952589 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 225/426] 10.222.0.20 () {62 vars in 1364 bytes} [Fri Sep 9 23:24:39 2022] POST /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-volume_attachments => generated 188 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:24:40.095732 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8d073809-0a40-4b37-ac64-f92062325877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:24:40.096335 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8d073809-0a40-4b37-ac64-f92062325877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:40.102193 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d073809-0a40-4b37-ac64-f92062325877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:40.102712 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d073809-0a40-4b37-ac64-f92062325877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:40.103151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d073809-0a40-4b37-ac64-f92062325877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:40.103890 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d073809-0a40-4b37-ac64-f92062325877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:40.104351 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d073809-0a40-4b37-ac64-f92062325877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:40.104782 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d073809-0a40-4b37-ac64-f92062325877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:40.148300 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8d073809-0a40-4b37-ac64-f92062325877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121058) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 23:24:40.429139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8d073809-0a40-4b37-ac64-f92062325877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "POST /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/action" status: 202 len: 0 microversion: 2.20 time: 0.337309 Sep 09 23:24:40.429788 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 202/427] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Sep 9 23:24:40 2022] POST /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:24:40.437939 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a2ad1069-cd38-42cc-83ff-02814cb78c28 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:40.438620 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a2ad1069-cd38-42cc-83ff-02814cb78c28 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:40.445439 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2ad1069-cd38-42cc-83ff-02814cb78c28 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:40.445922 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2ad1069-cd38-42cc-83ff-02814cb78c28 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:40.446376 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2ad1069-cd38-42cc-83ff-02814cb78c28 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:40.447268 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2ad1069-cd38-42cc-83ff-02814cb78c28 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:40.447501 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2ad1069-cd38-42cc-83ff-02814cb78c28 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:40.447917 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2ad1069-cd38-42cc-83ff-02814cb78c28 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:40.579042 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a2ad1069-cd38-42cc-83ff-02814cb78c28 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:40.587432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a2ad1069-cd38-42cc-83ff-02814cb78c28 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:40.588864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a2ad1069-cd38-42cc-83ff-02814cb78c28 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:40.590001 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a2ad1069-cd38-42cc-83ff-02814cb78c28 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1744 microversion: 2.20 time: 0.156102 Sep 09 23:24:40.590597 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 226/428] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:40 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:41.618305 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4cc41de4-78d4-448e-a1d4-f05e22274ad0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:41.618941 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4cc41de4-78d4-448e-a1d4-f05e22274ad0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:41.625364 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4cc41de4-78d4-448e-a1d4-f05e22274ad0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:41.625843 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4cc41de4-78d4-448e-a1d4-f05e22274ad0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:41.626273 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4cc41de4-78d4-448e-a1d4-f05e22274ad0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:41.626982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4cc41de4-78d4-448e-a1d4-f05e22274ad0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:41.627436 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4cc41de4-78d4-448e-a1d4-f05e22274ad0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:41.627901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4cc41de4-78d4-448e-a1d4-f05e22274ad0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:41.773808 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4cc41de4-78d4-448e-a1d4-f05e22274ad0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:41.783261 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4cc41de4-78d4-448e-a1d4-f05e22274ad0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:41.784703 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4cc41de4-78d4-448e-a1d4-f05e22274ad0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:41.785879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4cc41de4-78d4-448e-a1d4-f05e22274ad0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1744 microversion: 2.20 time: 0.171993 Sep 09 23:24:41.786634 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 203/429] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:41 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:42.812606 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-cdf6e039-acb9-4203-a5a7-5072425b421b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:42.813147 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-cdf6e039-acb9-4203-a5a7-5072425b421b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:42.819784 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cdf6e039-acb9-4203-a5a7-5072425b421b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:42.820264 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cdf6e039-acb9-4203-a5a7-5072425b421b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:42.820694 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cdf6e039-acb9-4203-a5a7-5072425b421b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:42.821379 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cdf6e039-acb9-4203-a5a7-5072425b421b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:42.821833 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cdf6e039-acb9-4203-a5a7-5072425b421b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:42.822257 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cdf6e039-acb9-4203-a5a7-5072425b421b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:42.955193 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cdf6e039-acb9-4203-a5a7-5072425b421b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:42.964002 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cdf6e039-acb9-4203-a5a7-5072425b421b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:42.965738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cdf6e039-acb9-4203-a5a7-5072425b421b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:42.967204 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-cdf6e039-acb9-4203-a5a7-5072425b421b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.159523 Sep 09 23:24:42.968069 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 227/430] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:42 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:43.993928 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-12211b70-f0ee-49c7-860f-4818c99a82b8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:43.994764 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-12211b70-f0ee-49c7-860f-4818c99a82b8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:44.001779 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-12211b70-f0ee-49c7-860f-4818c99a82b8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:44.002264 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-12211b70-f0ee-49c7-860f-4818c99a82b8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:44.002843 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-12211b70-f0ee-49c7-860f-4818c99a82b8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:44.005579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-12211b70-f0ee-49c7-860f-4818c99a82b8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:44.005579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-12211b70-f0ee-49c7-860f-4818c99a82b8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:44.005579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-12211b70-f0ee-49c7-860f-4818c99a82b8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:44.142818 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-12211b70-f0ee-49c7-860f-4818c99a82b8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:44.151882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-12211b70-f0ee-49c7-860f-4818c99a82b8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:44.153321 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-12211b70-f0ee-49c7-860f-4818c99a82b8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:44.154517 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-12211b70-f0ee-49c7-860f-4818c99a82b8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.164519 Sep 09 23:24:44.155092 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 204/431] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:43 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:45.179477 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8e4976f4-3214-4d59-bd7d-63d80692f441 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:45.180092 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8e4976f4-3214-4d59-bd7d-63d80692f441 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:45.182572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=42 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:24:45.187899 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e4976f4-3214-4d59-bd7d-63d80692f441 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:45.188389 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e4976f4-3214-4d59-bd7d-63d80692f441 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:45.188830 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e4976f4-3214-4d59-bd7d-63d80692f441 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:45.189536 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e4976f4-3214-4d59-bd7d-63d80692f441 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:45.190000 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e4976f4-3214-4d59-bd7d-63d80692f441 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:45.193369 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e4976f4-3214-4d59-bd7d-63d80692f441 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:45.325901 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8e4976f4-3214-4d59-bd7d-63d80692f441 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:45.334816 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8e4976f4-3214-4d59-bd7d-63d80692f441 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:45.336253 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8e4976f4-3214-4d59-bd7d-63d80692f441 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:45.337449 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8e4976f4-3214-4d59-bd7d-63d80692f441 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.161782 Sep 09 23:24:45.337999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 228/432] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:45 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:46.364337 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4fa1f20b-0d56-4537-b5c2-9686e83bb9fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:46.364954 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4fa1f20b-0d56-4537-b5c2-9686e83bb9fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:46.371548 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4fa1f20b-0d56-4537-b5c2-9686e83bb9fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:46.372034 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4fa1f20b-0d56-4537-b5c2-9686e83bb9fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:46.372479 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4fa1f20b-0d56-4537-b5c2-9686e83bb9fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:46.373168 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4fa1f20b-0d56-4537-b5c2-9686e83bb9fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:46.374162 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4fa1f20b-0d56-4537-b5c2-9686e83bb9fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:46.374735 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4fa1f20b-0d56-4537-b5c2-9686e83bb9fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:46.502673 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4fa1f20b-0d56-4537-b5c2-9686e83bb9fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:46.511189 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4fa1f20b-0d56-4537-b5c2-9686e83bb9fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:46.512647 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4fa1f20b-0d56-4537-b5c2-9686e83bb9fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:46.513807 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4fa1f20b-0d56-4537-b5c2-9686e83bb9fc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.153387 Sep 09 23:24:46.514489 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 205/433] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:46 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:47.540111 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fd61c273-b385-468f-a63f-fd00611fa667 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:47.540725 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-fd61c273-b385-468f-a63f-fd00611fa667 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:47.547954 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd61c273-b385-468f-a63f-fd00611fa667 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:47.548441 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd61c273-b385-468f-a63f-fd00611fa667 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:47.548906 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd61c273-b385-468f-a63f-fd00611fa667 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:47.549594 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd61c273-b385-468f-a63f-fd00611fa667 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:47.550051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd61c273-b385-468f-a63f-fd00611fa667 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:47.550525 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd61c273-b385-468f-a63f-fd00611fa667 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:47.680999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fd61c273-b385-468f-a63f-fd00611fa667 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:47.689814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fd61c273-b385-468f-a63f-fd00611fa667 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:47.691330 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fd61c273-b385-468f-a63f-fd00611fa667 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:47.692594 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-fd61c273-b385-468f-a63f-fd00611fa667 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.156318 Sep 09 23:24:47.693041 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 229/434] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:47 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:48.719003 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-d4e7e313-9dc7-41e7-8516-687a9b4232ad tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:48.719622 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-d4e7e313-9dc7-41e7-8516-687a9b4232ad tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:48.722021 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:24:48.726745 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4e7e313-9dc7-41e7-8516-687a9b4232ad tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:48.727234 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4e7e313-9dc7-41e7-8516-687a9b4232ad tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:48.727676 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4e7e313-9dc7-41e7-8516-687a9b4232ad tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:48.728371 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4e7e313-9dc7-41e7-8516-687a9b4232ad tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:48.728833 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4e7e313-9dc7-41e7-8516-687a9b4232ad tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:48.729261 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4e7e313-9dc7-41e7-8516-687a9b4232ad tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:48.868183 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d4e7e313-9dc7-41e7-8516-687a9b4232ad tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:48.877393 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d4e7e313-9dc7-41e7-8516-687a9b4232ad tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:48.878889 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d4e7e313-9dc7-41e7-8516-687a9b4232ad tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:48.880055 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-d4e7e313-9dc7-41e7-8516-687a9b4232ad tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.165139 Sep 09 23:24:48.880633 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 206/435] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:48 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:49.906374 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-2ece1f7a-a665-482a-bbce-f154c3afabf2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:49.906994 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-2ece1f7a-a665-482a-bbce-f154c3afabf2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:49.913679 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2ece1f7a-a665-482a-bbce-f154c3afabf2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:49.914166 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2ece1f7a-a665-482a-bbce-f154c3afabf2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:49.914639 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2ece1f7a-a665-482a-bbce-f154c3afabf2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:49.915330 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2ece1f7a-a665-482a-bbce-f154c3afabf2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:49.915791 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2ece1f7a-a665-482a-bbce-f154c3afabf2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:49.916219 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2ece1f7a-a665-482a-bbce-f154c3afabf2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:50.048479 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-2ece1f7a-a665-482a-bbce-f154c3afabf2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:50.057042 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-2ece1f7a-a665-482a-bbce-f154c3afabf2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:50.058520 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-2ece1f7a-a665-482a-bbce-f154c3afabf2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:50.059673 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-2ece1f7a-a665-482a-bbce-f154c3afabf2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.157913 Sep 09 23:24:50.060228 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 230/436] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:49 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:51.087381 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-d2be2b7a-c468-4be1-8d88-e0f9c6a166b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:51.087999 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-d2be2b7a-c468-4be1-8d88-e0f9c6a166b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:51.095599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d2be2b7a-c468-4be1-8d88-e0f9c6a166b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:51.096082 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d2be2b7a-c468-4be1-8d88-e0f9c6a166b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:51.096519 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d2be2b7a-c468-4be1-8d88-e0f9c6a166b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:51.097232 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d2be2b7a-c468-4be1-8d88-e0f9c6a166b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:51.097704 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d2be2b7a-c468-4be1-8d88-e0f9c6a166b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:51.098111 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d2be2b7a-c468-4be1-8d88-e0f9c6a166b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:51.230629 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d2be2b7a-c468-4be1-8d88-e0f9c6a166b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:51.239497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d2be2b7a-c468-4be1-8d88-e0f9c6a166b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:51.240920 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d2be2b7a-c468-4be1-8d88-e0f9c6a166b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:51.242060 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-d2be2b7a-c468-4be1-8d88-e0f9c6a166b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.158676 Sep 09 23:24:51.242654 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 207/437] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:51 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:52.268855 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fc2f5787-d1c2-4595-8960-ba091261a2b1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:52.269368 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-fc2f5787-d1c2-4595-8960-ba091261a2b1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:52.276541 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fc2f5787-d1c2-4595-8960-ba091261a2b1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:52.277025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fc2f5787-d1c2-4595-8960-ba091261a2b1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:52.277460 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fc2f5787-d1c2-4595-8960-ba091261a2b1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:52.278166 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fc2f5787-d1c2-4595-8960-ba091261a2b1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:52.278655 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fc2f5787-d1c2-4595-8960-ba091261a2b1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:52.279078 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fc2f5787-d1c2-4595-8960-ba091261a2b1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:52.412033 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fc2f5787-d1c2-4595-8960-ba091261a2b1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:52.421070 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fc2f5787-d1c2-4595-8960-ba091261a2b1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:52.423133 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fc2f5787-d1c2-4595-8960-ba091261a2b1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:52.424585 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-fc2f5787-d1c2-4595-8960-ba091261a2b1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.159553 Sep 09 23:24:52.425150 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 231/438] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:52 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:53.450391 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3d2f7cef-d3ef-4f93-8d32-b0ab6542af2b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:53.451006 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3d2f7cef-d3ef-4f93-8d32-b0ab6542af2b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:53.458130 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3d2f7cef-d3ef-4f93-8d32-b0ab6542af2b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:53.458645 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3d2f7cef-d3ef-4f93-8d32-b0ab6542af2b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:53.459085 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3d2f7cef-d3ef-4f93-8d32-b0ab6542af2b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:53.459801 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3d2f7cef-d3ef-4f93-8d32-b0ab6542af2b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:53.460259 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3d2f7cef-d3ef-4f93-8d32-b0ab6542af2b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:53.460687 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3d2f7cef-d3ef-4f93-8d32-b0ab6542af2b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:53.592045 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3d2f7cef-d3ef-4f93-8d32-b0ab6542af2b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:53.600766 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3d2f7cef-d3ef-4f93-8d32-b0ab6542af2b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:53.602221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3d2f7cef-d3ef-4f93-8d32-b0ab6542af2b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:53.603415 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3d2f7cef-d3ef-4f93-8d32-b0ab6542af2b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.157037 Sep 09 23:24:53.603999 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 208/439] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:53 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:54.631450 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-2b1300f4-72b1-49a6-8e35-219d26d078a4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:54.632081 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-2b1300f4-72b1-49a6-8e35-219d26d078a4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:54.641316 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b1300f4-72b1-49a6-8e35-219d26d078a4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:54.641737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b1300f4-72b1-49a6-8e35-219d26d078a4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:54.642172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b1300f4-72b1-49a6-8e35-219d26d078a4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:54.642951 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b1300f4-72b1-49a6-8e35-219d26d078a4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:54.643409 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b1300f4-72b1-49a6-8e35-219d26d078a4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:54.643836 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b1300f4-72b1-49a6-8e35-219d26d078a4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:54.770042 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-2b1300f4-72b1-49a6-8e35-219d26d078a4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:54.778796 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-2b1300f4-72b1-49a6-8e35-219d26d078a4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:54.780608 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-2b1300f4-72b1-49a6-8e35-219d26d078a4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:54.781780 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-2b1300f4-72b1-49a6-8e35-219d26d078a4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.155527 Sep 09 23:24:54.782364 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 232/440] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:54 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:55.807341 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-deed879a-8d3f-4d03-aca0-07303bb6a208 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:55.807881 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-deed879a-8d3f-4d03-aca0-07303bb6a208 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:55.815026 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-deed879a-8d3f-4d03-aca0-07303bb6a208 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:55.815511 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-deed879a-8d3f-4d03-aca0-07303bb6a208 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:55.815944 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-deed879a-8d3f-4d03-aca0-07303bb6a208 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:55.816637 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-deed879a-8d3f-4d03-aca0-07303bb6a208 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:55.817166 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-deed879a-8d3f-4d03-aca0-07303bb6a208 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:55.817597 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-deed879a-8d3f-4d03-aca0-07303bb6a208 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:55.943939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-deed879a-8d3f-4d03-aca0-07303bb6a208 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:55.953964 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-deed879a-8d3f-4d03-aca0-07303bb6a208 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:55.955436 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-deed879a-8d3f-4d03-aca0-07303bb6a208 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:55.956754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-deed879a-8d3f-4d03-aca0-07303bb6a208 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.153346 Sep 09 23:24:55.957297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 209/441] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:55 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:56.984486 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-bf8c4e3d-8b4b-44a2-9e87-0c78b4f552ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:56.985084 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-bf8c4e3d-8b4b-44a2-9e87-0c78b4f552ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:56.991831 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bf8c4e3d-8b4b-44a2-9e87-0c78b4f552ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:56.992312 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bf8c4e3d-8b4b-44a2-9e87-0c78b4f552ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:56.992744 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bf8c4e3d-8b4b-44a2-9e87-0c78b4f552ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:56.993433 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bf8c4e3d-8b4b-44a2-9e87-0c78b4f552ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:56.993883 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bf8c4e3d-8b4b-44a2-9e87-0c78b4f552ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:56.994305 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bf8c4e3d-8b4b-44a2-9e87-0c78b4f552ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:57.202932 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-bf8c4e3d-8b4b-44a2-9e87-0c78b4f552ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:57.205745 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:24:57.211505 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-bf8c4e3d-8b4b-44a2-9e87-0c78b4f552ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:57.213043 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-bf8c4e3d-8b4b-44a2-9e87-0c78b4f552ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:57.214490 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-bf8c4e3d-8b4b-44a2-9e87-0c78b4f552ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.234419 Sep 09 23:24:57.215112 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 233/442] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:56 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:57.341108 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-f2f16ca2-9650-49ee-9756-73c649eb8d1d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:24:57.344210 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-f2f16ca2-9650-49ee-9756-73c649eb8d1d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:57.352116 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f2f16ca2-9650-49ee-9756-73c649eb8d1d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:57.352952 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f2f16ca2-9650-49ee-9756-73c649eb8d1d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:57.353748 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f2f16ca2-9650-49ee-9756-73c649eb8d1d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:57.355046 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f2f16ca2-9650-49ee-9756-73c649eb8d1d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:57.355866 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f2f16ca2-9650-49ee-9756-73c649eb8d1d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:57.356642 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f2f16ca2-9650-49ee-9756-73c649eb8d1d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:57.387102 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-f2f16ca2-9650-49ee-9756-73c649eb8d1d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lazy-loading 'flavor' on Instance uuid 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:24:57.675208 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-f2f16ca2-9650-49ee-9756-73c649eb8d1d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "POST /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/action" status: 200 len: 32 microversion: 2.1 time: 0.337932 Sep 09 23:24:57.675848 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 210/443] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 23:24:57 2022] POST /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/action => generated 32 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:24:57.686627 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-acec4099-55c1-42b7-8503-35c485ccef97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:57.687247 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-acec4099-55c1-42b7-8503-35c485ccef97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:57.693400 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-acec4099-55c1-42b7-8503-35c485ccef97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:57.693912 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-acec4099-55c1-42b7-8503-35c485ccef97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:57.694365 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-acec4099-55c1-42b7-8503-35c485ccef97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:57.695041 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-acec4099-55c1-42b7-8503-35c485ccef97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:57.695498 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-acec4099-55c1-42b7-8503-35c485ccef97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:57.695918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-acec4099-55c1-42b7-8503-35c485ccef97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:57.857120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-acec4099-55c1-42b7-8503-35c485ccef97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:57.865889 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-acec4099-55c1-42b7-8503-35c485ccef97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.184114 Sep 09 23:24:57.866490 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 234/444] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:24:57 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:24:58.245117 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9045b23a-8485-4696-be8a-8b36fb5a2317 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:58.245810 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9045b23a-8485-4696-be8a-8b36fb5a2317 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:58.253972 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9045b23a-8485-4696-be8a-8b36fb5a2317 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:58.254535 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9045b23a-8485-4696-be8a-8b36fb5a2317 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:58.254961 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9045b23a-8485-4696-be8a-8b36fb5a2317 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:58.255667 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9045b23a-8485-4696-be8a-8b36fb5a2317 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:58.256121 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9045b23a-8485-4696-be8a-8b36fb5a2317 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:58.256556 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9045b23a-8485-4696-be8a-8b36fb5a2317 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:58.260751 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:24:58.400419 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9045b23a-8485-4696-be8a-8b36fb5a2317 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:58.409614 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9045b23a-8485-4696-be8a-8b36fb5a2317 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:58.411156 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9045b23a-8485-4696-be8a-8b36fb5a2317 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:58.412337 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9045b23a-8485-4696-be8a-8b36fb5a2317 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.171614 Sep 09 23:24:58.412919 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 211/445] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:58 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:24:58.888952 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1caf9504-2c85-4139-9325-7f465b6d64b2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:58.889560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1caf9504-2c85-4139-9325-7f465b6d64b2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:58.895924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1caf9504-2c85-4139-9325-7f465b6d64b2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:58.896405 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1caf9504-2c85-4139-9325-7f465b6d64b2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:58.896838 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1caf9504-2c85-4139-9325-7f465b6d64b2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:58.897524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1caf9504-2c85-4139-9325-7f465b6d64b2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:58.897975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1caf9504-2c85-4139-9325-7f465b6d64b2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:58.898431 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1caf9504-2c85-4139-9325-7f465b6d64b2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:59.036600 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1caf9504-2c85-4139-9325-7f465b6d64b2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:59.044845 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1caf9504-2c85-4139-9325-7f465b6d64b2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.159640 Sep 09 23:24:59.046407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 235/446] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:24:58 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:24:59.440210 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-37867457-9051-48b8-9e8e-4f562596e6ce tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:24:59.440820 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-37867457-9051-48b8-9e8e-4f562596e6ce tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:24:59.447782 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37867457-9051-48b8-9e8e-4f562596e6ce tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:59.448262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37867457-9051-48b8-9e8e-4f562596e6ce tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:59.448692 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37867457-9051-48b8-9e8e-4f562596e6ce tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:59.449663 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37867457-9051-48b8-9e8e-4f562596e6ce tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:24:59.450073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37867457-9051-48b8-9e8e-4f562596e6ce tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:24:59.450585 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37867457-9051-48b8-9e8e-4f562596e6ce tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:24:59.586700 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-37867457-9051-48b8-9e8e-4f562596e6ce tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:59.596972 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-37867457-9051-48b8-9e8e-4f562596e6ce tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:59.600574 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-37867457-9051-48b8-9e8e-4f562596e6ce tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:24:59.600574 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-37867457-9051-48b8-9e8e-4f562596e6ce tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.164448 Sep 09 23:24:59.600574 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 212/447] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:24:59 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:00.069148 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-65a7d13a-5adc-4c8e-b762-b012e9d43551 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:00.069808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-65a7d13a-5adc-4c8e-b762-b012e9d43551 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:00.075982 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-65a7d13a-5adc-4c8e-b762-b012e9d43551 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:00.076526 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-65a7d13a-5adc-4c8e-b762-b012e9d43551 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:00.077006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-65a7d13a-5adc-4c8e-b762-b012e9d43551 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:00.077709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-65a7d13a-5adc-4c8e-b762-b012e9d43551 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:00.078160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-65a7d13a-5adc-4c8e-b762-b012e9d43551 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:00.078603 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-65a7d13a-5adc-4c8e-b762-b012e9d43551 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:00.210117 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-65a7d13a-5adc-4c8e-b762-b012e9d43551 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:00.219525 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-65a7d13a-5adc-4c8e-b762-b012e9d43551 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.154200 Sep 09 23:25:00.220061 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 236/448] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:00 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:00.627681 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-bb822296-16f8-4411-acdb-4e60af5df7ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:00.628353 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-bb822296-16f8-4411-acdb-4e60af5df7ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:00.635024 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bb822296-16f8-4411-acdb-4e60af5df7ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:00.635520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bb822296-16f8-4411-acdb-4e60af5df7ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:00.635970 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bb822296-16f8-4411-acdb-4e60af5df7ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:00.636682 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bb822296-16f8-4411-acdb-4e60af5df7ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:00.637140 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bb822296-16f8-4411-acdb-4e60af5df7ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:00.637572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bb822296-16f8-4411-acdb-4e60af5df7ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:00.770239 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bb822296-16f8-4411-acdb-4e60af5df7ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:00.779011 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bb822296-16f8-4411-acdb-4e60af5df7ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:00.781112 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bb822296-16f8-4411-acdb-4e60af5df7ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:00.782293 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-bb822296-16f8-4411-acdb-4e60af5df7ae tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.159054 Sep 09 23:25:00.782881 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 213/449] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:00 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:01.243355 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b588429d-1414-4f11-9168-c95cbf2a339e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:01.244012 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b588429d-1414-4f11-9168-c95cbf2a339e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:01.250582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b588429d-1414-4f11-9168-c95cbf2a339e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:01.251069 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b588429d-1414-4f11-9168-c95cbf2a339e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:01.251516 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b588429d-1414-4f11-9168-c95cbf2a339e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:01.252238 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b588429d-1414-4f11-9168-c95cbf2a339e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:01.252690 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b588429d-1414-4f11-9168-c95cbf2a339e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:01.253112 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b588429d-1414-4f11-9168-c95cbf2a339e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:01.385321 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b588429d-1414-4f11-9168-c95cbf2a339e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:01.395125 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b588429d-1414-4f11-9168-c95cbf2a339e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.154807 Sep 09 23:25:01.395125 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 237/450] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:01 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:01.808326 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-68215993-80de-4c3b-b829-264e8bc79b4a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:01.808857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-68215993-80de-4c3b-b829-264e8bc79b4a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:01.816062 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-68215993-80de-4c3b-b829-264e8bc79b4a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:01.816541 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-68215993-80de-4c3b-b829-264e8bc79b4a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:01.816971 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-68215993-80de-4c3b-b829-264e8bc79b4a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:01.817672 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-68215993-80de-4c3b-b829-264e8bc79b4a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:01.823706 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-68215993-80de-4c3b-b829-264e8bc79b4a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:01.833570 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-68215993-80de-4c3b-b829-264e8bc79b4a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:01.951079 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-68215993-80de-4c3b-b829-264e8bc79b4a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:01.960312 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-68215993-80de-4c3b-b829-264e8bc79b4a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:01.961813 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-68215993-80de-4c3b-b829-264e8bc79b4a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:01.962981 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-68215993-80de-4c3b-b829-264e8bc79b4a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.158653 Sep 09 23:25:01.963533 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 214/451] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:01 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:25:02.424334 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d0373f0d-765e-4044-aea7-2439671449e8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:02.425340 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d0373f0d-765e-4044-aea7-2439671449e8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:02.431342 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d0373f0d-765e-4044-aea7-2439671449e8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:02.434676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d0373f0d-765e-4044-aea7-2439671449e8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:02.434676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d0373f0d-765e-4044-aea7-2439671449e8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:02.434676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d0373f0d-765e-4044-aea7-2439671449e8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:02.434676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d0373f0d-765e-4044-aea7-2439671449e8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:02.435091 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d0373f0d-765e-4044-aea7-2439671449e8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:02.567360 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d0373f0d-765e-4044-aea7-2439671449e8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:02.577054 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d0373f0d-765e-4044-aea7-2439671449e8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.158380 Sep 09 23:25:02.595426 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 238/452] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:02 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:02.990122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-57244d59-cbad-43ab-bef6-bb7485e347b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:02.990812 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-57244d59-cbad-43ab-bef6-bb7485e347b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:02.997205 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-57244d59-cbad-43ab-bef6-bb7485e347b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:02.997745 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-57244d59-cbad-43ab-bef6-bb7485e347b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:02.998228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-57244d59-cbad-43ab-bef6-bb7485e347b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:02.999327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-57244d59-cbad-43ab-bef6-bb7485e347b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:02.999789 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-57244d59-cbad-43ab-bef6-bb7485e347b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:03.000221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-57244d59-cbad-43ab-bef6-bb7485e347b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:03.133228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-57244d59-cbad-43ab-bef6-bb7485e347b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:03.143060 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-57244d59-cbad-43ab-bef6-bb7485e347b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:03.144542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-57244d59-cbad-43ab-bef6-bb7485e347b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:03.145707 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-57244d59-cbad-43ab-bef6-bb7485e347b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.159489 Sep 09 23:25:03.146266 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 215/453] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:02 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:03.606929 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-98f3ddc6-ab7d-48be-8f66-c5893b7a801b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:03.607896 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-98f3ddc6-ab7d-48be-8f66-c5893b7a801b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:03.614814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-98f3ddc6-ab7d-48be-8f66-c5893b7a801b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:03.615381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-98f3ddc6-ab7d-48be-8f66-c5893b7a801b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:03.615922 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-98f3ddc6-ab7d-48be-8f66-c5893b7a801b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:03.616697 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-98f3ddc6-ab7d-48be-8f66-c5893b7a801b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:03.617296 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-98f3ddc6-ab7d-48be-8f66-c5893b7a801b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:03.617821 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-98f3ddc6-ab7d-48be-8f66-c5893b7a801b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:03.758603 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-98f3ddc6-ab7d-48be-8f66-c5893b7a801b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:03.768044 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-98f3ddc6-ab7d-48be-8f66-c5893b7a801b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.165018 Sep 09 23:25:03.768621 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 239/454] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:03 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:04.171766 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-98ba805d-2128-4743-abc4-b3f924852399 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:04.172378 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-98ba805d-2128-4743-abc4-b3f924852399 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:04.178895 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-98ba805d-2128-4743-abc4-b3f924852399 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:04.179412 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-98ba805d-2128-4743-abc4-b3f924852399 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:04.179852 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-98ba805d-2128-4743-abc4-b3f924852399 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:04.180545 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-98ba805d-2128-4743-abc4-b3f924852399 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:04.181003 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-98ba805d-2128-4743-abc4-b3f924852399 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:04.181433 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-98ba805d-2128-4743-abc4-b3f924852399 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:04.309068 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-98ba805d-2128-4743-abc4-b3f924852399 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:04.317861 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-98ba805d-2128-4743-abc4-b3f924852399 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:04.319347 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-98ba805d-2128-4743-abc4-b3f924852399 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:04.320537 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-98ba805d-2128-4743-abc4-b3f924852399 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.153275 Sep 09 23:25:04.321098 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 216/455] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:04 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:04.791739 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5cfd3808-fd42-4faa-a9b9-c2ef263b8403 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:04.792377 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5cfd3808-fd42-4faa-a9b9-c2ef263b8403 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:04.798864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5cfd3808-fd42-4faa-a9b9-c2ef263b8403 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:04.799347 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5cfd3808-fd42-4faa-a9b9-c2ef263b8403 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:04.799782 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5cfd3808-fd42-4faa-a9b9-c2ef263b8403 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:04.800473 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5cfd3808-fd42-4faa-a9b9-c2ef263b8403 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:04.800925 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5cfd3808-fd42-4faa-a9b9-c2ef263b8403 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:04.801344 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5cfd3808-fd42-4faa-a9b9-c2ef263b8403 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:04.929168 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5cfd3808-fd42-4faa-a9b9-c2ef263b8403 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:04.937791 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5cfd3808-fd42-4faa-a9b9-c2ef263b8403 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.149869 Sep 09 23:25:04.938379 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 240/456] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:04 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:05.348039 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ccf56140-df31-4e9e-bcfb-977e24342a21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:05.348649 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ccf56140-df31-4e9e-bcfb-977e24342a21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:05.355035 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ccf56140-df31-4e9e-bcfb-977e24342a21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:05.355520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ccf56140-df31-4e9e-bcfb-977e24342a21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:05.355959 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ccf56140-df31-4e9e-bcfb-977e24342a21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:05.356654 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ccf56140-df31-4e9e-bcfb-977e24342a21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:05.357108 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ccf56140-df31-4e9e-bcfb-977e24342a21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:05.357537 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ccf56140-df31-4e9e-bcfb-977e24342a21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:05.500092 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ccf56140-df31-4e9e-bcfb-977e24342a21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:05.501993 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-545877172", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452"}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:25:05.509300 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ccf56140-df31-4e9e-bcfb-977e24342a21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:05.510775 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ccf56140-df31-4e9e-bcfb-977e24342a21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:05.511934 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ccf56140-df31-4e9e-bcfb-977e24342a21 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.167952 Sep 09 23:25:05.512533 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 217/457] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:05 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:05.556064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.network.neutron [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] validate_networks() for None {{(pid=121059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:25:05.861043 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Flavor limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:25:05.861634 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Image limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:25:05.861917 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Flavor pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:25:05.862321 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Image pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:25:05.862754 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:25:05.871375 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:05.871849 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:05.872277 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:05.872993 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:05.873444 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:05.874391 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:05.892110 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Getting quotas for project d4694a14825f4600a0336e150452a9cf. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:25:05.896210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Getting quotas for user 4398271cfc094e81b7a120bdeeb6dafe and project d4694a14825f4600a0336e150452a9cf. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:25:05.907408 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Going to run 1 instances... {{(pid=121059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:25:05.909703 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:25:05.962009 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-d54c6e89-80e9-4a07-86a5-886c49ff820b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:05.962655 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-d54c6e89-80e9-4a07-86a5-886c49ff820b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:05.968652 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d54c6e89-80e9-4a07-86a5-886c49ff820b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:05.969135 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d54c6e89-80e9-4a07-86a5-886c49ff820b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:05.969579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d54c6e89-80e9-4a07-86a5-886c49ff820b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:05.970277 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d54c6e89-80e9-4a07-86a5-886c49ff820b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:05.970764 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d54c6e89-80e9-4a07-86a5-886c49ff820b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:05.971195 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d54c6e89-80e9-4a07-86a5-886c49ff820b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:06.055264 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-6330bc5b-c12f-427a-9364-faccf60d3a0f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558028 Sep 09 23:25:06.056052 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 241/458] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:25:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 23:25:06.067393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-30f01f2e-2e82-4b90-9fc6-c2277ceff6ce tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:06.073090 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-30f01f2e-2e82-4b90-9fc6-c2277ceff6ce tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:06.124567 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d54c6e89-80e9-4a07-86a5-886c49ff820b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:06.134175 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-d54c6e89-80e9-4a07-86a5-886c49ff820b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.176112 Sep 09 23:25:06.138843 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 218/459] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:05 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:06.138956 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-30f01f2e-2e82-4b90-9fc6-c2277ceff6ce tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:06.145641 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-30f01f2e-2e82-4b90-9fc6-c2277ceff6ce tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1214 microversion: 2.1 time: 0.081696 Sep 09 23:25:06.146448 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 242/460] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:06 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:06.538119 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b965fd22-3f87-4005-aa76-06a40d662a7c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:06.538757 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b965fd22-3f87-4005-aa76-06a40d662a7c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:06.545322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b965fd22-3f87-4005-aa76-06a40d662a7c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:06.546575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b965fd22-3f87-4005-aa76-06a40d662a7c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:06.546997 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b965fd22-3f87-4005-aa76-06a40d662a7c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:06.547677 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b965fd22-3f87-4005-aa76-06a40d662a7c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:06.548125 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b965fd22-3f87-4005-aa76-06a40d662a7c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:06.548545 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b965fd22-3f87-4005-aa76-06a40d662a7c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:06.688009 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b965fd22-3f87-4005-aa76-06a40d662a7c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:06.696546 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b965fd22-3f87-4005-aa76-06a40d662a7c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:06.697978 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b965fd22-3f87-4005-aa76-06a40d662a7c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:06.699156 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b965fd22-3f87-4005-aa76-06a40d662a7c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.164931 Sep 09 23:25:06.699717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 219/461] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:06 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:07.158992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1e2c714a-0b32-4a14-9e71-6016606a1196 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:07.159646 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1e2c714a-0b32-4a14-9e71-6016606a1196 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:07.166297 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1e2c714a-0b32-4a14-9e71-6016606a1196 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:07.166808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1e2c714a-0b32-4a14-9e71-6016606a1196 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:07.167245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1e2c714a-0b32-4a14-9e71-6016606a1196 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:07.167966 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1e2c714a-0b32-4a14-9e71-6016606a1196 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:07.168073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a5e48b63-aa7b-4a85-ae57-1908c48e4cad tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:07.168413 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1e2c714a-0b32-4a14-9e71-6016606a1196 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:07.168630 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a5e48b63-aa7b-4a85-ae57-1908c48e4cad tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:07.168833 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1e2c714a-0b32-4a14-9e71-6016606a1196 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:07.174805 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a5e48b63-aa7b-4a85-ae57-1908c48e4cad tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:07.175291 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a5e48b63-aa7b-4a85-ae57-1908c48e4cad tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:07.175874 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a5e48b63-aa7b-4a85-ae57-1908c48e4cad tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:07.176574 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a5e48b63-aa7b-4a85-ae57-1908c48e4cad tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:07.177035 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a5e48b63-aa7b-4a85-ae57-1908c48e4cad tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:07.177461 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a5e48b63-aa7b-4a85-ae57-1908c48e4cad tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:07.243555 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a5e48b63-aa7b-4a85-ae57-1908c48e4cad tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:07.251944 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a5e48b63-aa7b-4a85-ae57-1908c48e4cad tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1218 microversion: 2.1 time: 0.087865 Sep 09 23:25:07.252523 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 220/462] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:07 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:07.303055 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1e2c714a-0b32-4a14-9e71-6016606a1196 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:07.311249 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1e2c714a-0b32-4a14-9e71-6016606a1196 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.157028 Sep 09 23:25:07.311811 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 243/463] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:07 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:07.726050 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8fe6d58c-2aff-47fd-8f49-4ff53bb8fca7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:07.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8fe6d58c-2aff-47fd-8f49-4ff53bb8fca7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:07.733788 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8fe6d58c-2aff-47fd-8f49-4ff53bb8fca7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:07.734415 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8fe6d58c-2aff-47fd-8f49-4ff53bb8fca7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:07.734905 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8fe6d58c-2aff-47fd-8f49-4ff53bb8fca7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:07.735589 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8fe6d58c-2aff-47fd-8f49-4ff53bb8fca7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:07.736037 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8fe6d58c-2aff-47fd-8f49-4ff53bb8fca7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:07.736458 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8fe6d58c-2aff-47fd-8f49-4ff53bb8fca7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:07.865731 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8fe6d58c-2aff-47fd-8f49-4ff53bb8fca7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:07.875249 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8fe6d58c-2aff-47fd-8f49-4ff53bb8fca7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:07.876714 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8fe6d58c-2aff-47fd-8f49-4ff53bb8fca7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:07.877872 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8fe6d58c-2aff-47fd-8f49-4ff53bb8fca7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.155796 Sep 09 23:25:07.878489 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 221/464] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:07 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:08.276398 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5747d3e8-0b89-4f64-8cf1-671edded7ea8 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:08.277003 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5747d3e8-0b89-4f64-8cf1-671edded7ea8 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:08.284405 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5747d3e8-0b89-4f64-8cf1-671edded7ea8 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:08.284885 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5747d3e8-0b89-4f64-8cf1-671edded7ea8 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:08.285313 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5747d3e8-0b89-4f64-8cf1-671edded7ea8 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:08.285988 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5747d3e8-0b89-4f64-8cf1-671edded7ea8 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:08.286467 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5747d3e8-0b89-4f64-8cf1-671edded7ea8 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:08.286884 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5747d3e8-0b89-4f64-8cf1-671edded7ea8 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:08.334022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-747b1ce2-3806-4079-a1cf-b5b60d5c8993 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:08.334660 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-747b1ce2-3806-4079-a1cf-b5b60d5c8993 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:08.340670 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-747b1ce2-3806-4079-a1cf-b5b60d5c8993 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:08.341147 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-747b1ce2-3806-4079-a1cf-b5b60d5c8993 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:08.341581 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-747b1ce2-3806-4079-a1cf-b5b60d5c8993 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:08.342263 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-747b1ce2-3806-4079-a1cf-b5b60d5c8993 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:08.343416 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-747b1ce2-3806-4079-a1cf-b5b60d5c8993 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:08.343994 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-747b1ce2-3806-4079-a1cf-b5b60d5c8993 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:08.348027 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5747d3e8-0b89-4f64-8cf1-671edded7ea8 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:08.355689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5747d3e8-0b89-4f64-8cf1-671edded7ea8 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1218 microversion: 2.1 time: 0.083171 Sep 09 23:25:08.356261 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 244/465] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:08 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:08.471243 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-747b1ce2-3806-4079-a1cf-b5b60d5c8993 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:08.479283 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-747b1ce2-3806-4079-a1cf-b5b60d5c8993 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.149054 Sep 09 23:25:08.479851 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 222/466] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:08 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:08.903221 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b478d429-343a-49e3-9ddc-cb9833a64b30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:08.903830 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b478d429-343a-49e3-9ddc-cb9833a64b30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:08.910189 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b478d429-343a-49e3-9ddc-cb9833a64b30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:08.910703 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b478d429-343a-49e3-9ddc-cb9833a64b30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:08.911140 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b478d429-343a-49e3-9ddc-cb9833a64b30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:08.911832 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b478d429-343a-49e3-9ddc-cb9833a64b30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:08.912286 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b478d429-343a-49e3-9ddc-cb9833a64b30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:08.912708 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b478d429-343a-49e3-9ddc-cb9833a64b30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:09.043252 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b478d429-343a-49e3-9ddc-cb9833a64b30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:09.052128 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b478d429-343a-49e3-9ddc-cb9833a64b30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:09.067613 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b478d429-343a-49e3-9ddc-cb9833a64b30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:09.067613 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b478d429-343a-49e3-9ddc-cb9833a64b30 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.155444 Sep 09 23:25:09.067613 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 245/467] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:08 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:09.378897 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-d750d3f7-5d5b-465e-b017-2db127df2dd0 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:09.379543 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-d750d3f7-5d5b-465e-b017-2db127df2dd0 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:09.385826 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d750d3f7-5d5b-465e-b017-2db127df2dd0 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:09.386309 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d750d3f7-5d5b-465e-b017-2db127df2dd0 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:09.386781 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d750d3f7-5d5b-465e-b017-2db127df2dd0 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:09.387468 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d750d3f7-5d5b-465e-b017-2db127df2dd0 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:09.387922 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d750d3f7-5d5b-465e-b017-2db127df2dd0 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:09.388348 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d750d3f7-5d5b-465e-b017-2db127df2dd0 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:09.456337 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d750d3f7-5d5b-465e-b017-2db127df2dd0 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:09.464012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-d750d3f7-5d5b-465e-b017-2db127df2dd0 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1218 microversion: 2.1 time: 0.088949 Sep 09 23:25:09.464581 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 223/468] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:09 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:09.504628 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-76cdaa17-e933-425d-ad32-e53bb2ef891d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:09.505229 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-76cdaa17-e933-425d-ad32-e53bb2ef891d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:09.511595 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-76cdaa17-e933-425d-ad32-e53bb2ef891d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:09.512069 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-76cdaa17-e933-425d-ad32-e53bb2ef891d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:09.512500 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-76cdaa17-e933-425d-ad32-e53bb2ef891d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:09.513178 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-76cdaa17-e933-425d-ad32-e53bb2ef891d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:09.513626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-76cdaa17-e933-425d-ad32-e53bb2ef891d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:09.514045 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-76cdaa17-e933-425d-ad32-e53bb2ef891d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:09.641750 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-76cdaa17-e933-425d-ad32-e53bb2ef891d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:09.650021 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-76cdaa17-e933-425d-ad32-e53bb2ef891d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.149253 Sep 09 23:25:09.650630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 246/469] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:09 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:10.081795 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5ab03408-fee0-4aa8-abe2-1d2179064aff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:10.083530 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5ab03408-fee0-4aa8-abe2-1d2179064aff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:10.089817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5ab03408-fee0-4aa8-abe2-1d2179064aff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:10.090303 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5ab03408-fee0-4aa8-abe2-1d2179064aff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:10.090773 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5ab03408-fee0-4aa8-abe2-1d2179064aff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:10.091519 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5ab03408-fee0-4aa8-abe2-1d2179064aff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:10.091972 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5ab03408-fee0-4aa8-abe2-1d2179064aff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:10.092429 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5ab03408-fee0-4aa8-abe2-1d2179064aff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:10.298676 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5ab03408-fee0-4aa8-abe2-1d2179064aff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:10.315652 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5ab03408-fee0-4aa8-abe2-1d2179064aff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:10.319471 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5ab03408-fee0-4aa8-abe2-1d2179064aff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:10.320818 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5ab03408-fee0-4aa8-abe2-1d2179064aff tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.243470 Sep 09 23:25:10.321809 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 224/470] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:10 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:10.488150 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3b11f328-0771-44d4-8e0a-086b7d8dad94 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:10.488763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3b11f328-0771-44d4-8e0a-086b7d8dad94 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:10.495044 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b11f328-0771-44d4-8e0a-086b7d8dad94 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:10.495526 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b11f328-0771-44d4-8e0a-086b7d8dad94 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:10.495959 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b11f328-0771-44d4-8e0a-086b7d8dad94 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:10.496840 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b11f328-0771-44d4-8e0a-086b7d8dad94 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:10.497290 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b11f328-0771-44d4-8e0a-086b7d8dad94 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:10.497710 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b11f328-0771-44d4-8e0a-086b7d8dad94 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:10.561761 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3b11f328-0771-44d4-8e0a-086b7d8dad94 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:10.569654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3b11f328-0771-44d4-8e0a-086b7d8dad94 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1266 microversion: 2.1 time: 0.086222 Sep 09 23:25:10.570561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 247/471] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:10 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:10.673712 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a08b4d20-738b-4793-89a4-5967f0cc170d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:10.675109 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a08b4d20-738b-4793-89a4-5967f0cc170d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:10.682412 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a08b4d20-738b-4793-89a4-5967f0cc170d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:10.682901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a08b4d20-738b-4793-89a4-5967f0cc170d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:10.683341 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a08b4d20-738b-4793-89a4-5967f0cc170d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:10.684074 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a08b4d20-738b-4793-89a4-5967f0cc170d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:10.684526 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a08b4d20-738b-4793-89a4-5967f0cc170d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:10.684951 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a08b4d20-738b-4793-89a4-5967f0cc170d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:10.847077 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a08b4d20-738b-4793-89a4-5967f0cc170d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:10.855418 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a08b4d20-738b-4793-89a4-5967f0cc170d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.186262 Sep 09 23:25:10.856102 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 225/472] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:10 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:11.162779 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-cc8a2533-4866-4e1d-ae99-7a065ec43863 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:25:11.168730 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cc8a2533-4866-4e1d-ae99-7a065ec43863 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:11.169208 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cc8a2533-4866-4e1d-ae99-7a065ec43863 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:11.169651 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cc8a2533-4866-4e1d-ae99-7a065ec43863 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:11.231129 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-cc8a2533-4866-4e1d-ae99-7a065ec43863 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Going to try to stop instance {{(pid=121059) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 23:25:11.349361 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-caabe9c2-6d81-4ab3-b7f1-044554aa85eb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:11.349965 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-caabe9c2-6d81-4ab3-b7f1-044554aa85eb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:11.356200 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-caabe9c2-6d81-4ab3-b7f1-044554aa85eb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:11.356643 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-caabe9c2-6d81-4ab3-b7f1-044554aa85eb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:11.357084 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-caabe9c2-6d81-4ab3-b7f1-044554aa85eb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:11.357776 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-caabe9c2-6d81-4ab3-b7f1-044554aa85eb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:11.359119 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-caabe9c2-6d81-4ab3-b7f1-044554aa85eb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:11.359592 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-caabe9c2-6d81-4ab3-b7f1-044554aa85eb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:11.464912 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-cc8a2533-4866-4e1d-ae99-7a065ec43863 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "POST /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/action" status: 202 len: 0 microversion: 2.1 time: 0.305401 Sep 09 23:25:11.468657 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 248/473] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 23:25:11 2022] POST /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:25:11.475847 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1175c5bc-9d97-4e2f-a7e3-068514ef0cfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:11.476544 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1175c5bc-9d97-4e2f-a7e3-068514ef0cfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:11.482898 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1175c5bc-9d97-4e2f-a7e3-068514ef0cfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:11.483915 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1175c5bc-9d97-4e2f-a7e3-068514ef0cfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:11.484569 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1175c5bc-9d97-4e2f-a7e3-068514ef0cfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:11.485206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1175c5bc-9d97-4e2f-a7e3-068514ef0cfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:11.485667 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1175c5bc-9d97-4e2f-a7e3-068514ef0cfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:11.486097 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1175c5bc-9d97-4e2f-a7e3-068514ef0cfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:11.494543 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-caabe9c2-6d81-4ab3-b7f1-044554aa85eb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:11.503277 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-caabe9c2-6d81-4ab3-b7f1-044554aa85eb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:11.504824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-caabe9c2-6d81-4ab3-b7f1-044554aa85eb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:11.505954 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-caabe9c2-6d81-4ab3-b7f1-044554aa85eb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.160702 Sep 09 23:25:11.506533 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 226/474] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:11 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:11.594944 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8d2637cd-928d-43ef-93b8-d4be014ee35b tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:11.595557 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8d2637cd-928d-43ef-93b8-d4be014ee35b tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:11.601403 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d2637cd-928d-43ef-93b8-d4be014ee35b tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:11.601879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d2637cd-928d-43ef-93b8-d4be014ee35b tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:11.602310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d2637cd-928d-43ef-93b8-d4be014ee35b tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:11.603017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d2637cd-928d-43ef-93b8-d4be014ee35b tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:11.603470 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d2637cd-928d-43ef-93b8-d4be014ee35b tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:11.603887 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d2637cd-928d-43ef-93b8-d4be014ee35b tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:11.615300 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1175c5bc-9d97-4e2f-a7e3-068514ef0cfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:11.623485 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1175c5bc-9d97-4e2f-a7e3-068514ef0cfc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1678 microversion: 2.1 time: 0.151862 Sep 09 23:25:11.624240 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 249/475] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:11 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:11.679097 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8d2637cd-928d-43ef-93b8-d4be014ee35b tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:11.681689 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=100 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:25:11.687743 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8d2637cd-928d-43ef-93b8-d4be014ee35b tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1274 microversion: 2.1 time: 0.097276 Sep 09 23:25:11.688309 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 227/476] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:11 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:11.880392 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4780e216-3dfc-4306-a5cd-01b750335a9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:11.880911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4780e216-3dfc-4306-a5cd-01b750335a9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:11.887257 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4780e216-3dfc-4306-a5cd-01b750335a9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:11.887759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4780e216-3dfc-4306-a5cd-01b750335a9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:11.888193 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4780e216-3dfc-4306-a5cd-01b750335a9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:11.888875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4780e216-3dfc-4306-a5cd-01b750335a9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:11.889358 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4780e216-3dfc-4306-a5cd-01b750335a9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:11.890448 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4780e216-3dfc-4306-a5cd-01b750335a9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:12.023011 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4780e216-3dfc-4306-a5cd-01b750335a9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:12.031245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4780e216-3dfc-4306-a5cd-01b750335a9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.154865 Sep 09 23:25:12.031804 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 250/477] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:11 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:12.532832 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-aa4b9c0b-20a8-4dfe-a0a0-6dfe775cd83d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:12.533450 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-aa4b9c0b-20a8-4dfe-a0a0-6dfe775cd83d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:12.539749 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-aa4b9c0b-20a8-4dfe-a0a0-6dfe775cd83d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:12.540234 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-aa4b9c0b-20a8-4dfe-a0a0-6dfe775cd83d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:12.540672 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-aa4b9c0b-20a8-4dfe-a0a0-6dfe775cd83d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:12.541364 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-aa4b9c0b-20a8-4dfe-a0a0-6dfe775cd83d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:12.541828 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-aa4b9c0b-20a8-4dfe-a0a0-6dfe775cd83d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:12.542257 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-aa4b9c0b-20a8-4dfe-a0a0-6dfe775cd83d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:12.646883 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5d621382-d197-4213-9de9-60fb24ed1e8f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:12.647495 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5d621382-d197-4213-9de9-60fb24ed1e8f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:12.654080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d621382-d197-4213-9de9-60fb24ed1e8f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:12.654607 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d621382-d197-4213-9de9-60fb24ed1e8f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:12.656539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d621382-d197-4213-9de9-60fb24ed1e8f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:12.657279 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d621382-d197-4213-9de9-60fb24ed1e8f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:12.657744 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d621382-d197-4213-9de9-60fb24ed1e8f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:12.658173 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d621382-d197-4213-9de9-60fb24ed1e8f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:12.662857 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:25:12.797314 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5d621382-d197-4213-9de9-60fb24ed1e8f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:12.805288 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5d621382-d197-4213-9de9-60fb24ed1e8f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1678 microversion: 2.1 time: 0.162177 Sep 09 23:25:12.805872 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 251/478] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:12 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:12.810786 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-512f9a9e-09e8-49ee-a94e-c9b985a50194 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:12.811992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-512f9a9e-09e8-49ee-a94e-c9b985a50194 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:12.819305 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-512f9a9e-09e8-49ee-a94e-c9b985a50194 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:12.819916 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-512f9a9e-09e8-49ee-a94e-c9b985a50194 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:12.820479 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-512f9a9e-09e8-49ee-a94e-c9b985a50194 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:12.821279 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-512f9a9e-09e8-49ee-a94e-c9b985a50194 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:12.821836 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-512f9a9e-09e8-49ee-a94e-c9b985a50194 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:12.822416 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-512f9a9e-09e8-49ee-a94e-c9b985a50194 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:12.884820 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-512f9a9e-09e8-49ee-a94e-c9b985a50194 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:12.893534 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-512f9a9e-09e8-49ee-a94e-c9b985a50194 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1274 microversion: 2.1 time: 0.086655 Sep 09 23:25:12.894124 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 252/479] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:12 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:12.898383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-aa4b9c0b-20a8-4dfe-a0a0-6dfe775cd83d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:12.907243 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-aa4b9c0b-20a8-4dfe-a0a0-6dfe775cd83d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:12.908673 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-aa4b9c0b-20a8-4dfe-a0a0-6dfe775cd83d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:12.909820 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-aa4b9c0b-20a8-4dfe-a0a0-6dfe775cd83d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.381185 Sep 09 23:25:12.910385 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 228/480] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:12 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:25:13.054848 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-12fae3af-59a2-4f21-a0f0-526830484251 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:13.055602 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-12fae3af-59a2-4f21-a0f0-526830484251 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:13.062228 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12fae3af-59a2-4f21-a0f0-526830484251 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:13.062841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12fae3af-59a2-4f21-a0f0-526830484251 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:13.063278 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12fae3af-59a2-4f21-a0f0-526830484251 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:13.063969 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12fae3af-59a2-4f21-a0f0-526830484251 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:13.064460 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12fae3af-59a2-4f21-a0f0-526830484251 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:13.064891 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12fae3af-59a2-4f21-a0f0-526830484251 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:13.198573 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-12fae3af-59a2-4f21-a0f0-526830484251 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:13.206880 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-12fae3af-59a2-4f21-a0f0-526830484251 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.155969 Sep 09 23:25:13.210824 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 253/481] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:13 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:13.829036 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-678e6516-1948-4923-92e0-79ec80e62ddc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:13.829676 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-678e6516-1948-4923-92e0-79ec80e62ddc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:13.836080 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-678e6516-1948-4923-92e0-79ec80e62ddc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:13.836558 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-678e6516-1948-4923-92e0-79ec80e62ddc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:13.836994 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-678e6516-1948-4923-92e0-79ec80e62ddc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:13.837676 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-678e6516-1948-4923-92e0-79ec80e62ddc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:13.838133 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-678e6516-1948-4923-92e0-79ec80e62ddc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:13.838596 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-678e6516-1948-4923-92e0-79ec80e62ddc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:13.917010 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-9683c035-70c7-4583-9ac7-81e34523765c tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:13.917684 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-9683c035-70c7-4583-9ac7-81e34523765c tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:13.924239 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9683c035-70c7-4583-9ac7-81e34523765c tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:13.924721 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9683c035-70c7-4583-9ac7-81e34523765c tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:13.925154 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9683c035-70c7-4583-9ac7-81e34523765c tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:13.925841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9683c035-70c7-4583-9ac7-81e34523765c tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:13.926295 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9683c035-70c7-4583-9ac7-81e34523765c tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:13.926740 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9683c035-70c7-4583-9ac7-81e34523765c tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:13.973180 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-678e6516-1948-4923-92e0-79ec80e62ddc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:13.982516 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-678e6516-1948-4923-92e0-79ec80e62ddc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1678 microversion: 2.1 time: 0.158157 Sep 09 23:25:13.991292 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 229/482] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:13 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:13.991292 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-613d9b6b-0ee8-431a-9ae8-20ecf2fd693b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:13.992367 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-613d9b6b-0ee8-431a-9ae8-20ecf2fd693b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:13.994320 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-9683c035-70c7-4583-9ac7-81e34523765c tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:14.000418 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-613d9b6b-0ee8-431a-9ae8-20ecf2fd693b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:14.001207 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-613d9b6b-0ee8-431a-9ae8-20ecf2fd693b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:14.001773 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-613d9b6b-0ee8-431a-9ae8-20ecf2fd693b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:14.002326 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-613d9b6b-0ee8-431a-9ae8-20ecf2fd693b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:14.002992 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-613d9b6b-0ee8-431a-9ae8-20ecf2fd693b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:14.003567 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-613d9b6b-0ee8-431a-9ae8-20ecf2fd693b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:14.011056 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-9683c035-70c7-4583-9ac7-81e34523765c tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1274 microversion: 2.1 time: 0.097786 Sep 09 23:25:14.016138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 254/483] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:13 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:14.231034 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3ef2950f-89c0-4da5-a669-adf056acc561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:14.231820 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3ef2950f-89c0-4da5-a669-adf056acc561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:14.239263 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ef2950f-89c0-4da5-a669-adf056acc561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:14.239895 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ef2950f-89c0-4da5-a669-adf056acc561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:14.240432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ef2950f-89c0-4da5-a669-adf056acc561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:14.241573 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ef2950f-89c0-4da5-a669-adf056acc561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:14.242258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ef2950f-89c0-4da5-a669-adf056acc561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:14.242963 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ef2950f-89c0-4da5-a669-adf056acc561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:14.397138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3ef2950f-89c0-4da5-a669-adf056acc561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:14.407450 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3ef2950f-89c0-4da5-a669-adf056acc561 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.180685 Sep 09 23:25:14.409157 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 255/484] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:14 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:14.410620 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-613d9b6b-0ee8-431a-9ae8-20ecf2fd693b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:14.423021 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-613d9b6b-0ee8-431a-9ae8-20ecf2fd693b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:14.430720 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-613d9b6b-0ee8-431a-9ae8-20ecf2fd693b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:14.432289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-613d9b6b-0ee8-431a-9ae8-20ecf2fd693b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1746 microversion: 2.20 time: 0.447246 Sep 09 23:25:14.432858 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 230/485] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:13 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1746 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:15.007112 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1bce9fc1-7a1d-46a7-ae3b-e3a8b847461f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:15.010729 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1bce9fc1-7a1d-46a7-ae3b-e3a8b847461f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:15.014094 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1bce9fc1-7a1d-46a7-ae3b-e3a8b847461f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:15.014676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1bce9fc1-7a1d-46a7-ae3b-e3a8b847461f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:15.015110 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1bce9fc1-7a1d-46a7-ae3b-e3a8b847461f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:15.016613 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1bce9fc1-7a1d-46a7-ae3b-e3a8b847461f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:15.017124 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1bce9fc1-7a1d-46a7-ae3b-e3a8b847461f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:15.018174 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1bce9fc1-7a1d-46a7-ae3b-e3a8b847461f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:15.043038 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-43e9c079-df65-4eff-96e8-755c20f5ad0d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:15.043740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-43e9c079-df65-4eff-96e8-755c20f5ad0d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:15.051278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43e9c079-df65-4eff-96e8-755c20f5ad0d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:15.052030 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43e9c079-df65-4eff-96e8-755c20f5ad0d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:15.053257 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43e9c079-df65-4eff-96e8-755c20f5ad0d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:15.054203 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43e9c079-df65-4eff-96e8-755c20f5ad0d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:15.054872 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43e9c079-df65-4eff-96e8-755c20f5ad0d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:15.055493 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43e9c079-df65-4eff-96e8-755c20f5ad0d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:15.158959 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-43e9c079-df65-4eff-96e8-755c20f5ad0d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:15.167971 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1bce9fc1-7a1d-46a7-ae3b-e3a8b847461f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:15.177575 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1bce9fc1-7a1d-46a7-ae3b-e3a8b847461f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1678 microversion: 2.1 time: 0.174505 Sep 09 23:25:15.178539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 256/486] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:15 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:15.192792 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-43e9c079-df65-4eff-96e8-755c20f5ad0d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1272 microversion: 2.1 time: 0.145840 Sep 09 23:25:15.192792 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 231/487] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:15 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:15.434624 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-84adea36-d1bc-4051-9421-8dfa00960bfc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:15.435491 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-84adea36-d1bc-4051-9421-8dfa00960bfc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:15.437652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:25:15.442590 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-84adea36-d1bc-4051-9421-8dfa00960bfc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:15.443322 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-84adea36-d1bc-4051-9421-8dfa00960bfc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:15.443766 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-84adea36-d1bc-4051-9421-8dfa00960bfc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:15.444524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-84adea36-d1bc-4051-9421-8dfa00960bfc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:15.444989 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-84adea36-d1bc-4051-9421-8dfa00960bfc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:15.445419 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-84adea36-d1bc-4051-9421-8dfa00960bfc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:15.466306 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8f92b780-16e1-41c0-a78e-f7e8de6e1033 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:15.466972 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8f92b780-16e1-41c0-a78e-f7e8de6e1033 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:15.474088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8f92b780-16e1-41c0-a78e-f7e8de6e1033 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:15.474882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8f92b780-16e1-41c0-a78e-f7e8de6e1033 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:15.475323 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8f92b780-16e1-41c0-a78e-f7e8de6e1033 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:15.476035 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8f92b780-16e1-41c0-a78e-f7e8de6e1033 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:15.476489 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8f92b780-16e1-41c0-a78e-f7e8de6e1033 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:15.476915 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8f92b780-16e1-41c0-a78e-f7e8de6e1033 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:15.617669 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-84adea36-d1bc-4051-9421-8dfa00960bfc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:15.633884 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-84adea36-d1bc-4051-9421-8dfa00960bfc tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.203327 Sep 09 23:25:15.643363 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 257/488] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:15 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:15.770095 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8f92b780-16e1-41c0-a78e-f7e8de6e1033 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:15.783736 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8f92b780-16e1-41c0-a78e-f7e8de6e1033 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:15.785220 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8f92b780-16e1-41c0-a78e-f7e8de6e1033 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:15.786416 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8f92b780-16e1-41c0-a78e-f7e8de6e1033 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.323997 Sep 09 23:25:15.800493 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 232/489] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:15 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:25:16.220029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7e8939e5-2464-45a6-beac-c3ea7d1d1d02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:16.220648 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7e8939e5-2464-45a6-beac-c3ea7d1d1d02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:16.222543 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=2 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:25:16.223885 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=8 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:25:16.227713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-50bff0f3-a8db-4536-bb15-0bf0b918409f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:16.228445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-50bff0f3-a8db-4536-bb15-0bf0b918409f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:16.229182 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7e8939e5-2464-45a6-beac-c3ea7d1d1d02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:16.229668 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7e8939e5-2464-45a6-beac-c3ea7d1d1d02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:16.230210 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7e8939e5-2464-45a6-beac-c3ea7d1d1d02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:16.231027 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7e8939e5-2464-45a6-beac-c3ea7d1d1d02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:16.231519 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7e8939e5-2464-45a6-beac-c3ea7d1d1d02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:16.231952 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7e8939e5-2464-45a6-beac-c3ea7d1d1d02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:16.235788 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-50bff0f3-a8db-4536-bb15-0bf0b918409f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:16.236275 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-50bff0f3-a8db-4536-bb15-0bf0b918409f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:16.236765 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-50bff0f3-a8db-4536-bb15-0bf0b918409f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:16.237479 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-50bff0f3-a8db-4536-bb15-0bf0b918409f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:16.237961 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-50bff0f3-a8db-4536-bb15-0bf0b918409f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:16.238412 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-50bff0f3-a8db-4536-bb15-0bf0b918409f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:16.369257 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7e8939e5-2464-45a6-beac-c3ea7d1d1d02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:16.377599 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7e8939e5-2464-45a6-beac-c3ea7d1d1d02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1678 microversion: 2.1 time: 0.162039 Sep 09 23:25:16.378160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 258/490] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:16 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:16.499883 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-50bff0f3-a8db-4536-bb15-0bf0b918409f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:16.507967 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-50bff0f3-a8db-4536-bb15-0bf0b918409f tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.284266 Sep 09 23:25:16.508893 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 233/491] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:16 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:16.666711 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fb64eccb-7e7a-4ee2-95a5-15f27287abef tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:16.667365 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-fb64eccb-7e7a-4ee2-95a5-15f27287abef tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:16.674585 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb64eccb-7e7a-4ee2-95a5-15f27287abef tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:16.675001 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb64eccb-7e7a-4ee2-95a5-15f27287abef tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:16.675444 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb64eccb-7e7a-4ee2-95a5-15f27287abef tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:16.676158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb64eccb-7e7a-4ee2-95a5-15f27287abef tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:16.676739 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb64eccb-7e7a-4ee2-95a5-15f27287abef tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:16.677192 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb64eccb-7e7a-4ee2-95a5-15f27287abef tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:16.819763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fb64eccb-7e7a-4ee2-95a5-15f27287abef tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:16.823658 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-81ef1e6a-121d-4d4c-a701-27b65e5f50d4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:16.824309 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-81ef1e6a-121d-4d4c-a701-27b65e5f50d4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:16.830175 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-fb64eccb-7e7a-4ee2-95a5-15f27287abef tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.167364 Sep 09 23:25:16.830927 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 259/492] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:16 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:16.831587 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-81ef1e6a-121d-4d4c-a701-27b65e5f50d4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:16.832083 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-81ef1e6a-121d-4d4c-a701-27b65e5f50d4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:16.832519 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-81ef1e6a-121d-4d4c-a701-27b65e5f50d4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:16.833230 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-81ef1e6a-121d-4d4c-a701-27b65e5f50d4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:16.833687 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-81ef1e6a-121d-4d4c-a701-27b65e5f50d4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:16.834111 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-81ef1e6a-121d-4d4c-a701-27b65e5f50d4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:17.080295 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-81ef1e6a-121d-4d4c-a701-27b65e5f50d4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:17.089492 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-81ef1e6a-121d-4d4c-a701-27b65e5f50d4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:17.091420 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-81ef1e6a-121d-4d4c-a701-27b65e5f50d4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:17.093302 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-81ef1e6a-121d-4d4c-a701-27b65e5f50d4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.280638 Sep 09 23:25:17.094643 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 234/493] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:16 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:25:17.406950 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8272a80f-c365-4d16-beee-ec40bd510858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:17.408036 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8272a80f-c365-4d16-beee-ec40bd510858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:17.418982 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8272a80f-c365-4d16-beee-ec40bd510858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:17.421690 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8272a80f-c365-4d16-beee-ec40bd510858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:17.422469 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8272a80f-c365-4d16-beee-ec40bd510858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:17.423564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8272a80f-c365-4d16-beee-ec40bd510858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:17.424272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8272a80f-c365-4d16-beee-ec40bd510858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:17.424923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8272a80f-c365-4d16-beee-ec40bd510858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:17.533915 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e27ef138-3910-4255-8d58-8050b61881e3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:17.534577 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e27ef138-3910-4255-8d58-8050b61881e3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:17.543523 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e27ef138-3910-4255-8d58-8050b61881e3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:17.544216 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e27ef138-3910-4255-8d58-8050b61881e3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:17.545110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e27ef138-3910-4255-8d58-8050b61881e3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:17.546574 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e27ef138-3910-4255-8d58-8050b61881e3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:17.547506 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e27ef138-3910-4255-8d58-8050b61881e3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:17.548113 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e27ef138-3910-4255-8d58-8050b61881e3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:17.575906 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8272a80f-c365-4d16-beee-ec40bd510858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:17.585232 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8272a80f-c365-4d16-beee-ec40bd510858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1678 microversion: 2.1 time: 0.185806 Sep 09 23:25:17.586134 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 260/494] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:17 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:17.683929 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-534eec10-ad0b-44ba-a1fc-3628e4b2f301 req-54e63c0b-99c7-4cb8-9ebc-7f84caad384e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b99c3b-e692-4386-bbdf-e3dbc1a304b1", "tag": "5607c7a4-9f27-4940-9fd7-0f2ffa9cf82b"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:25:17.696707 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-534eec10-ad0b-44ba-a1fc-3628e4b2f301 req-54e63c0b-99c7-4cb8-9ebc-7f84caad384e service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:17.697594 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-534eec10-ad0b-44ba-a1fc-3628e4b2f301 req-54e63c0b-99c7-4cb8-9ebc-7f84caad384e service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:17.698567 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-534eec10-ad0b-44ba-a1fc-3628e4b2f301 req-54e63c0b-99c7-4cb8-9ebc-7f84caad384e service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:17.723399 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-534eec10-ad0b-44ba-a1fc-3628e4b2f301 req-54e63c0b-99c7-4cb8-9ebc-7f84caad384e service nova] Creating event network-changed:5607c7a4-9f27-4940-9fd7-0f2ffa9cf82b for instance 28b99c3b-e692-4386-bbdf-e3dbc1a304b1 on hv-cinder-85032 Sep 09 23:25:17.734186 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-534eec10-ad0b-44ba-a1fc-3628e4b2f301 req-54e63c0b-99c7-4cb8-9ebc-7f84caad384e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060297 Sep 09 23:25:17.735326 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 261/495] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:25:17.735704 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e27ef138-3910-4255-8d58-8050b61881e3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:17.756180 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e27ef138-3910-4255-8d58-8050b61881e3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.225816 Sep 09 23:25:17.759237 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 235/496] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:17 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:17.856023 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-191a56fc-cbc3-47f2-b3a9-a447236b82bf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:17.857047 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-191a56fc-cbc3-47f2-b3a9-a447236b82bf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:17.865066 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-191a56fc-cbc3-47f2-b3a9-a447236b82bf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:17.865835 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-191a56fc-cbc3-47f2-b3a9-a447236b82bf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:17.866469 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-191a56fc-cbc3-47f2-b3a9-a447236b82bf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:17.867369 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-191a56fc-cbc3-47f2-b3a9-a447236b82bf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:17.867989 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-191a56fc-cbc3-47f2-b3a9-a447236b82bf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:17.868569 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-191a56fc-cbc3-47f2-b3a9-a447236b82bf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:18.027927 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-191a56fc-cbc3-47f2-b3a9-a447236b82bf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:18.037768 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-191a56fc-cbc3-47f2-b3a9-a447236b82bf tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.186411 Sep 09 23:25:18.038887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 262/497] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:17 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:18.120509 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-73e7a615-da14-41e6-801f-30aa6e80c8b7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:18.121119 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-73e7a615-da14-41e6-801f-30aa6e80c8b7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:18.128108 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-73e7a615-da14-41e6-801f-30aa6e80c8b7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:18.128587 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-73e7a615-da14-41e6-801f-30aa6e80c8b7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:18.129209 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-73e7a615-da14-41e6-801f-30aa6e80c8b7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:18.129895 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-73e7a615-da14-41e6-801f-30aa6e80c8b7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:18.130641 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-73e7a615-da14-41e6-801f-30aa6e80c8b7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:18.131286 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-73e7a615-da14-41e6-801f-30aa6e80c8b7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:18.287308 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-73e7a615-da14-41e6-801f-30aa6e80c8b7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:18.297768 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-73e7a615-da14-41e6-801f-30aa6e80c8b7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:18.299526 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-73e7a615-da14-41e6-801f-30aa6e80c8b7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:18.300833 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-73e7a615-da14-41e6-801f-30aa6e80c8b7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.184239 Sep 09 23:25:18.301559 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 236/498] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:18 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:18.611364 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-74e70e32-33bc-4d2d-bf24-e46c5587d205 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:18.612060 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-74e70e32-33bc-4d2d-bf24-e46c5587d205 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:18.618085 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-74e70e32-33bc-4d2d-bf24-e46c5587d205 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:18.618602 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-74e70e32-33bc-4d2d-bf24-e46c5587d205 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:18.619038 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-74e70e32-33bc-4d2d-bf24-e46c5587d205 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:18.619957 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-74e70e32-33bc-4d2d-bf24-e46c5587d205 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:18.620416 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-74e70e32-33bc-4d2d-bf24-e46c5587d205 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:18.620911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-74e70e32-33bc-4d2d-bf24-e46c5587d205 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:18.772315 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-74e70e32-33bc-4d2d-bf24-e46c5587d205 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:18.782536 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8c3c4360-7a6d-400a-9ab9-523272108045 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:18.783269 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8c3c4360-7a6d-400a-9ab9-523272108045 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:18.792633 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-74e70e32-33bc-4d2d-bf24-e46c5587d205 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1678 microversion: 2.1 time: 0.186500 Sep 09 23:25:18.800790 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 263/499] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:18 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:18.800933 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8c3c4360-7a6d-400a-9ab9-523272108045 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:18.800933 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8c3c4360-7a6d-400a-9ab9-523272108045 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:18.800933 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8c3c4360-7a6d-400a-9ab9-523272108045 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:18.800933 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8c3c4360-7a6d-400a-9ab9-523272108045 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:18.801510 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8c3c4360-7a6d-400a-9ab9-523272108045 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:18.801510 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8c3c4360-7a6d-400a-9ab9-523272108045 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:18.941752 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8c3c4360-7a6d-400a-9ab9-523272108045 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:18.949905 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8c3c4360-7a6d-400a-9ab9-523272108045 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.172156 Sep 09 23:25:18.950968 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 237/500] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:18 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:19.061107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1b31d720-29fa-4df4-b6cb-e2eb57f18d2d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:19.061710 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1b31d720-29fa-4df4-b6cb-e2eb57f18d2d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:19.067661 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1b31d720-29fa-4df4-b6cb-e2eb57f18d2d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:19.068139 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1b31d720-29fa-4df4-b6cb-e2eb57f18d2d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:19.068569 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1b31d720-29fa-4df4-b6cb-e2eb57f18d2d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:19.069282 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1b31d720-29fa-4df4-b6cb-e2eb57f18d2d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:19.069746 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1b31d720-29fa-4df4-b6cb-e2eb57f18d2d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:19.070206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1b31d720-29fa-4df4-b6cb-e2eb57f18d2d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:19.276109 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1b31d720-29fa-4df4-b6cb-e2eb57f18d2d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:19.285168 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1b31d720-29fa-4df4-b6cb-e2eb57f18d2d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.227936 Sep 09 23:25:19.285748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 264/501] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:19 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:19.327575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-417171e2-ff91-418c-a53c-3e714d7bcb4b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:19.328386 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-417171e2-ff91-418c-a53c-3e714d7bcb4b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:19.330243 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=64 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:25:19.341640 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-417171e2-ff91-418c-a53c-3e714d7bcb4b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:19.342063 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-417171e2-ff91-418c-a53c-3e714d7bcb4b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:19.343059 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-417171e2-ff91-418c-a53c-3e714d7bcb4b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:19.345715 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-417171e2-ff91-418c-a53c-3e714d7bcb4b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:19.345715 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-417171e2-ff91-418c-a53c-3e714d7bcb4b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:19.345715 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-417171e2-ff91-418c-a53c-3e714d7bcb4b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:19.489024 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-417171e2-ff91-418c-a53c-3e714d7bcb4b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:19.499042 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-417171e2-ff91-418c-a53c-3e714d7bcb4b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:19.500671 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-417171e2-ff91-418c-a53c-3e714d7bcb4b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:19.501848 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-417171e2-ff91-418c-a53c-3e714d7bcb4b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.178458 Sep 09 23:25:19.502434 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 238/502] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:19 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:19.817819 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-99bfdebd-cdbe-4101-8c97-fdbb8aac2755 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:19.818515 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-99bfdebd-cdbe-4101-8c97-fdbb8aac2755 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:19.824916 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-99bfdebd-cdbe-4101-8c97-fdbb8aac2755 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:19.825633 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-99bfdebd-cdbe-4101-8c97-fdbb8aac2755 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:19.826246 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-99bfdebd-cdbe-4101-8c97-fdbb8aac2755 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:19.827725 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-99bfdebd-cdbe-4101-8c97-fdbb8aac2755 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:19.828361 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-99bfdebd-cdbe-4101-8c97-fdbb8aac2755 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:19.828779 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-99bfdebd-cdbe-4101-8c97-fdbb8aac2755 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:19.976261 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-dccf04cf-1255-477c-93b3-90d7b33ab457 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:19.977458 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-dccf04cf-1255-477c-93b3-90d7b33ab457 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:19.984648 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dccf04cf-1255-477c-93b3-90d7b33ab457 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:19.987256 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dccf04cf-1255-477c-93b3-90d7b33ab457 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:19.987928 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dccf04cf-1255-477c-93b3-90d7b33ab457 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:19.988890 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dccf04cf-1255-477c-93b3-90d7b33ab457 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:19.989584 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dccf04cf-1255-477c-93b3-90d7b33ab457 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:19.990514 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dccf04cf-1255-477c-93b3-90d7b33ab457 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:19.992747 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-99bfdebd-cdbe-4101-8c97-fdbb8aac2755 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:20.003853 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-99bfdebd-cdbe-4101-8c97-fdbb8aac2755 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1678 microversion: 2.1 time: 0.189883 Sep 09 23:25:20.005216 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 265/503] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:19 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:20.170499 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-dccf04cf-1255-477c-93b3-90d7b33ab457 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:20.179179 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-dccf04cf-1255-477c-93b3-90d7b33ab457 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.207099 Sep 09 23:25:20.181874 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 239/504] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:19 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:20.308996 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-37df4077-1d8b-457b-b106-b924f83f6fd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:20.316261 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-37df4077-1d8b-457b-b106-b924f83f6fd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:20.316261 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-37df4077-1d8b-457b-b106-b924f83f6fd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:20.316494 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-37df4077-1d8b-457b-b106-b924f83f6fd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:20.316852 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-37df4077-1d8b-457b-b106-b924f83f6fd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:20.317542 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-37df4077-1d8b-457b-b106-b924f83f6fd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:20.317999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-37df4077-1d8b-457b-b106-b924f83f6fd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:20.318515 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-37df4077-1d8b-457b-b106-b924f83f6fd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:20.467453 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-37df4077-1d8b-457b-b106-b924f83f6fd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:20.477730 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-37df4077-1d8b-457b-b106-b924f83f6fd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.172531 Sep 09 23:25:20.478787 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 266/505] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:20 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:20.528224 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-454fd54c-9da6-42b0-b398-568860530060 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:20.528878 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-454fd54c-9da6-42b0-b398-568860530060 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:20.535860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-454fd54c-9da6-42b0-b398-568860530060 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:20.536532 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-454fd54c-9da6-42b0-b398-568860530060 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:20.536950 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-454fd54c-9da6-42b0-b398-568860530060 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:20.537717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-454fd54c-9da6-42b0-b398-568860530060 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:20.538245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-454fd54c-9da6-42b0-b398-568860530060 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:20.538755 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-454fd54c-9da6-42b0-b398-568860530060 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:20.681400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-454fd54c-9da6-42b0-b398-568860530060 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:20.691926 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-454fd54c-9da6-42b0-b398-568860530060 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:20.693375 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-454fd54c-9da6-42b0-b398-568860530060 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:20.695597 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-454fd54c-9da6-42b0-b398-568860530060 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.171365 Sep 09 23:25:20.696737 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 240/506] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:20 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:21.031884 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-9fd7702a-8b87-4518-826a-93aab4b65ad5 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:21.032459 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-9fd7702a-8b87-4518-826a-93aab4b65ad5 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:21.039654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9fd7702a-8b87-4518-826a-93aab4b65ad5 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:21.040145 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9fd7702a-8b87-4518-826a-93aab4b65ad5 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:21.040586 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9fd7702a-8b87-4518-826a-93aab4b65ad5 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:21.041288 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9fd7702a-8b87-4518-826a-93aab4b65ad5 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:21.041742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9fd7702a-8b87-4518-826a-93aab4b65ad5 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:21.042169 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9fd7702a-8b87-4518-826a-93aab4b65ad5 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:21.192101 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-9fd7702a-8b87-4518-826a-93aab4b65ad5 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:21.203385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-9fd7702a-8b87-4518-826a-93aab4b65ad5 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1678 microversion: 2.1 time: 0.176396 Sep 09 23:25:21.204440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 267/507] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:21 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:21.204564 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-77811471-8b2e-44d2-ab12-76a46839469a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:21.205228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-77811471-8b2e-44d2-ab12-76a46839469a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:21.212145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-77811471-8b2e-44d2-ab12-76a46839469a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:21.212637 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-77811471-8b2e-44d2-ab12-76a46839469a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:21.213109 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-77811471-8b2e-44d2-ab12-76a46839469a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:21.213813 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-77811471-8b2e-44d2-ab12-76a46839469a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:21.214276 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-77811471-8b2e-44d2-ab12-76a46839469a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:21.214926 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-77811471-8b2e-44d2-ab12-76a46839469a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:21.360953 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-77811471-8b2e-44d2-ab12-76a46839469a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:21.376331 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-77811471-8b2e-44d2-ab12-76a46839469a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.176781 Sep 09 23:25:21.377212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 241/508] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:21 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:21.505134 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1d79280e-965c-4c05-9d86-4dc56a99502d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:21.505732 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1d79280e-965c-4c05-9d86-4dc56a99502d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:21.512843 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1d79280e-965c-4c05-9d86-4dc56a99502d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:21.513327 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1d79280e-965c-4c05-9d86-4dc56a99502d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:21.513758 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1d79280e-965c-4c05-9d86-4dc56a99502d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:21.514779 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1d79280e-965c-4c05-9d86-4dc56a99502d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:21.515470 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1d79280e-965c-4c05-9d86-4dc56a99502d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:21.515886 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1d79280e-965c-4c05-9d86-4dc56a99502d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:21.542141 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=100 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:25:21.681153 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1d79280e-965c-4c05-9d86-4dc56a99502d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:21.691063 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1d79280e-965c-4c05-9d86-4dc56a99502d tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.189748 Sep 09 23:25:21.694376 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 268/509] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:21 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:21.725661 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0c4ab75b-cf88-4baa-abc5-ad9bdfa60c01 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:21.726909 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0c4ab75b-cf88-4baa-abc5-ad9bdfa60c01 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:21.739571 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c4ab75b-cf88-4baa-abc5-ad9bdfa60c01 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:21.740152 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c4ab75b-cf88-4baa-abc5-ad9bdfa60c01 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:21.740600 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c4ab75b-cf88-4baa-abc5-ad9bdfa60c01 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:21.741991 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c4ab75b-cf88-4baa-abc5-ad9bdfa60c01 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:21.748094 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c4ab75b-cf88-4baa-abc5-ad9bdfa60c01 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:21.748094 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c4ab75b-cf88-4baa-abc5-ad9bdfa60c01 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:21.913910 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0c4ab75b-cf88-4baa-abc5-ad9bdfa60c01 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:21.924105 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0c4ab75b-cf88-4baa-abc5-ad9bdfa60c01 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:21.925996 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0c4ab75b-cf88-4baa-abc5-ad9bdfa60c01 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:21.927355 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0c4ab75b-cf88-4baa-abc5-ad9bdfa60c01 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.205596 Sep 09 23:25:21.928111 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 242/510] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:21 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:22.227874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-57827fd9-9b6b-4b87-a9e8-79db8c863ee8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:22.231415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-57827fd9-9b6b-4b87-a9e8-79db8c863ee8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:22.246778 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-57827fd9-9b6b-4b87-a9e8-79db8c863ee8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:22.247337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-57827fd9-9b6b-4b87-a9e8-79db8c863ee8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:22.247811 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-57827fd9-9b6b-4b87-a9e8-79db8c863ee8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:22.249244 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-57827fd9-9b6b-4b87-a9e8-79db8c863ee8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:22.249722 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-57827fd9-9b6b-4b87-a9e8-79db8c863ee8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:22.250181 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-57827fd9-9b6b-4b87-a9e8-79db8c863ee8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:22.405800 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8d3c4abf-661f-4094-991e-3f0e178150ac tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:22.406508 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8d3c4abf-661f-4094-991e-3f0e178150ac tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:22.416871 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d3c4abf-661f-4094-991e-3f0e178150ac tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:22.419218 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d3c4abf-661f-4094-991e-3f0e178150ac tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:22.419945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d3c4abf-661f-4094-991e-3f0e178150ac tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:22.421571 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d3c4abf-661f-4094-991e-3f0e178150ac tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:22.426094 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-57827fd9-9b6b-4b87-a9e8-79db8c863ee8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:22.427101 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d3c4abf-661f-4094-991e-3f0e178150ac tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:22.427629 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8d3c4abf-661f-4094-991e-3f0e178150ac tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:22.435522 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-57827fd9-9b6b-4b87-a9e8-79db8c863ee8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1678 microversion: 2.1 time: 0.211370 Sep 09 23:25:22.441122 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 269/511] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:22 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:22.632329 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8d3c4abf-661f-4094-991e-3f0e178150ac tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:22.642551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8d3c4abf-661f-4094-991e-3f0e178150ac tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.240944 Sep 09 23:25:22.659155 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 243/512] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:22 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:22.715101 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-49e24a17-446d-45d5-9890-bc37645e5cd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:22.716106 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-49e24a17-446d-45d5-9890-bc37645e5cd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:22.725692 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-49e24a17-446d-45d5-9890-bc37645e5cd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:22.726197 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-49e24a17-446d-45d5-9890-bc37645e5cd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:22.727232 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-49e24a17-446d-45d5-9890-bc37645e5cd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:22.729629 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-49e24a17-446d-45d5-9890-bc37645e5cd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:22.730618 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-49e24a17-446d-45d5-9890-bc37645e5cd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:22.731482 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-49e24a17-446d-45d5-9890-bc37645e5cd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:22.928404 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-49e24a17-446d-45d5-9890-bc37645e5cd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:22.937268 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-49e24a17-446d-45d5-9890-bc37645e5cd5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.225916 Sep 09 23:25:22.937834 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 270/513] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:22 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:22.955547 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b99a0401-e348-4839-9b9c-4ca7f61fa8fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:22.956541 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b99a0401-e348-4839-9b9c-4ca7f61fa8fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:22.966832 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b99a0401-e348-4839-9b9c-4ca7f61fa8fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:22.969937 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b99a0401-e348-4839-9b9c-4ca7f61fa8fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:22.970714 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b99a0401-e348-4839-9b9c-4ca7f61fa8fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:22.971656 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b99a0401-e348-4839-9b9c-4ca7f61fa8fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:22.972322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b99a0401-e348-4839-9b9c-4ca7f61fa8fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:22.974113 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b99a0401-e348-4839-9b9c-4ca7f61fa8fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:23.016649 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=100 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:25:23.159464 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b99a0401-e348-4839-9b9c-4ca7f61fa8fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:23.169753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b99a0401-e348-4839-9b9c-4ca7f61fa8fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:23.171575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b99a0401-e348-4839-9b9c-4ca7f61fa8fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:23.172769 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b99a0401-e348-4839-9b9c-4ca7f61fa8fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.222537 Sep 09 23:25:23.180076 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 244/514] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:22 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:23.460977 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-902a80c2-406f-4711-b8e6-f95b9b7203bf tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:23.461695 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-902a80c2-406f-4711-b8e6-f95b9b7203bf tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:23.469430 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-902a80c2-406f-4711-b8e6-f95b9b7203bf tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:23.470069 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-902a80c2-406f-4711-b8e6-f95b9b7203bf tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:23.470753 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-902a80c2-406f-4711-b8e6-f95b9b7203bf tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:23.471612 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-902a80c2-406f-4711-b8e6-f95b9b7203bf tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:23.472101 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-902a80c2-406f-4711-b8e6-f95b9b7203bf tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:23.472620 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-902a80c2-406f-4711-b8e6-f95b9b7203bf tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:23.660212 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-902a80c2-406f-4711-b8e6-f95b9b7203bf tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:23.666217 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-77fcf5bb-50e0-43ac-9e56-f24b0f5974da tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:23.669234 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-77fcf5bb-50e0-43ac-9e56-f24b0f5974da tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:23.687324 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-902a80c2-406f-4711-b8e6-f95b9b7203bf tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1678 microversion: 2.1 time: 0.223715 Sep 09 23:25:23.687964 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 271/515] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:23 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:23.689786 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-77fcf5bb-50e0-43ac-9e56-f24b0f5974da tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:23.690286 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-77fcf5bb-50e0-43ac-9e56-f24b0f5974da tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:23.690748 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-77fcf5bb-50e0-43ac-9e56-f24b0f5974da tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:23.691455 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-77fcf5bb-50e0-43ac-9e56-f24b0f5974da tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:23.692073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-77fcf5bb-50e0-43ac-9e56-f24b0f5974da tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:23.692509 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-77fcf5bb-50e0-43ac-9e56-f24b0f5974da tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:23.860098 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-77fcf5bb-50e0-43ac-9e56-f24b0f5974da tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:23.868286 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-77fcf5bb-50e0-43ac-9e56-f24b0f5974da tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.205828 Sep 09 23:25:23.883683 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 245/516] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:23 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:23.965525 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-49487de3-84c1-437b-8a13-735ed2ea8541 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:23.966134 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-49487de3-84c1-437b-8a13-735ed2ea8541 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:23.972754 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-49487de3-84c1-437b-8a13-735ed2ea8541 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:23.973244 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-49487de3-84c1-437b-8a13-735ed2ea8541 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:23.973674 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-49487de3-84c1-437b-8a13-735ed2ea8541 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:23.978237 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-49487de3-84c1-437b-8a13-735ed2ea8541 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:23.978237 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-49487de3-84c1-437b-8a13-735ed2ea8541 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:23.978237 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-49487de3-84c1-437b-8a13-735ed2ea8541 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:24.134272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-49487de3-84c1-437b-8a13-735ed2ea8541 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:24.146160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-49487de3-84c1-437b-8a13-735ed2ea8541 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.184919 Sep 09 23:25:24.146772 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 272/517] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:23 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:24.199725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-37c123af-7e40-4bf8-83e1-2ea752dc0542 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:24.201054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-37c123af-7e40-4bf8-83e1-2ea752dc0542 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:24.208277 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37c123af-7e40-4bf8-83e1-2ea752dc0542 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:24.209110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37c123af-7e40-4bf8-83e1-2ea752dc0542 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:24.209545 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37c123af-7e40-4bf8-83e1-2ea752dc0542 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:24.210362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37c123af-7e40-4bf8-83e1-2ea752dc0542 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:24.214392 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37c123af-7e40-4bf8-83e1-2ea752dc0542 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:24.214392 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37c123af-7e40-4bf8-83e1-2ea752dc0542 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:24.392488 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-37c123af-7e40-4bf8-83e1-2ea752dc0542 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:24.401921 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-37c123af-7e40-4bf8-83e1-2ea752dc0542 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:24.403427 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-37c123af-7e40-4bf8-83e1-2ea752dc0542 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:24.404622 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-37c123af-7e40-4bf8-83e1-2ea752dc0542 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.209048 Sep 09 23:25:24.405752 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 246/518] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:24 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:24.716323 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-44f49d79-471d-4241-9454-2efdadbba8cc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:24.718393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-44f49d79-471d-4241-9454-2efdadbba8cc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:24.750842 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-44f49d79-471d-4241-9454-2efdadbba8cc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:24.753481 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-44f49d79-471d-4241-9454-2efdadbba8cc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:24.754054 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-44f49d79-471d-4241-9454-2efdadbba8cc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:24.755887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-44f49d79-471d-4241-9454-2efdadbba8cc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:24.760108 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-44f49d79-471d-4241-9454-2efdadbba8cc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:24.760896 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-44f49d79-471d-4241-9454-2efdadbba8cc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:24.894811 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-dd07418c-e950-4f1f-9b19-eda6304da54a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:24.895459 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-dd07418c-e950-4f1f-9b19-eda6304da54a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:24.910716 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dd07418c-e950-4f1f-9b19-eda6304da54a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:24.911215 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dd07418c-e950-4f1f-9b19-eda6304da54a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:24.911659 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dd07418c-e950-4f1f-9b19-eda6304da54a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:24.912373 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dd07418c-e950-4f1f-9b19-eda6304da54a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:24.912837 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dd07418c-e950-4f1f-9b19-eda6304da54a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:24.913271 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dd07418c-e950-4f1f-9b19-eda6304da54a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:24.959257 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-44f49d79-471d-4241-9454-2efdadbba8cc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:24.967575 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-44f49d79-471d-4241-9454-2efdadbba8cc tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1678 microversion: 2.1 time: 0.256237 Sep 09 23:25:24.968450 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 273/519] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:24 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1678 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:25.078391 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-dd07418c-e950-4f1f-9b19-eda6304da54a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:25.086444 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-dd07418c-e950-4f1f-9b19-eda6304da54a tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.196402 Sep 09 23:25:25.087025 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 247/520] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:24 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:25.169490 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-61c7fe3c-0049-4191-a968-d5b25bf973f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:25.170062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-61c7fe3c-0049-4191-a968-d5b25bf973f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:25.176390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-61c7fe3c-0049-4191-a968-d5b25bf973f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:25.177037 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-61c7fe3c-0049-4191-a968-d5b25bf973f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:25.177632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-61c7fe3c-0049-4191-a968-d5b25bf973f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:25.178380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-61c7fe3c-0049-4191-a968-d5b25bf973f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:25.178846 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-61c7fe3c-0049-4191-a968-d5b25bf973f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:25.179513 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-61c7fe3c-0049-4191-a968-d5b25bf973f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:25.313647 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-61c7fe3c-0049-4191-a968-d5b25bf973f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:25.322907 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-61c7fe3c-0049-4191-a968-d5b25bf973f7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.157141 Sep 09 23:25:25.323710 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 274/521] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:25 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:25.431570 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ce80e776-d818-422d-9570-0bb106b9db5a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:25.432126 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ce80e776-d818-422d-9570-0bb106b9db5a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:25.438287 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ce80e776-d818-422d-9570-0bb106b9db5a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:25.438814 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ce80e776-d818-422d-9570-0bb106b9db5a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:25.439235 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ce80e776-d818-422d-9570-0bb106b9db5a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:25.439966 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ce80e776-d818-422d-9570-0bb106b9db5a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:25.440420 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ce80e776-d818-422d-9570-0bb106b9db5a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:25.440846 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ce80e776-d818-422d-9570-0bb106b9db5a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:25.576410 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ce80e776-d818-422d-9570-0bb106b9db5a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:25.585593 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ce80e776-d818-422d-9570-0bb106b9db5a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:25.587085 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ce80e776-d818-422d-9570-0bb106b9db5a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:25.588293 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ce80e776-d818-422d-9570-0bb106b9db5a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.160977 Sep 09 23:25:25.588914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 248/522] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:25 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:25.993435 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-362505e1-8d3d-48c4-b027-e25d153de7c4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:25.994061 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-362505e1-8d3d-48c4-b027-e25d153de7c4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:26.001272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-362505e1-8d3d-48c4-b027-e25d153de7c4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:26.001747 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-362505e1-8d3d-48c4-b027-e25d153de7c4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:26.002180 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-362505e1-8d3d-48c4-b027-e25d153de7c4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:26.002903 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-362505e1-8d3d-48c4-b027-e25d153de7c4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:26.003353 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-362505e1-8d3d-48c4-b027-e25d153de7c4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:26.003780 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-362505e1-8d3d-48c4-b027-e25d153de7c4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:26.111586 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0a1be4e9-965c-45f7-b337-cbf823c0f0f5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:26.113272 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0a1be4e9-965c-45f7-b337-cbf823c0f0f5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:26.118517 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a1be4e9-965c-45f7-b337-cbf823c0f0f5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:26.119113 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a1be4e9-965c-45f7-b337-cbf823c0f0f5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:26.119556 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a1be4e9-965c-45f7-b337-cbf823c0f0f5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:26.120242 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a1be4e9-965c-45f7-b337-cbf823c0f0f5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:26.120693 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a1be4e9-965c-45f7-b337-cbf823c0f0f5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:26.121113 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a1be4e9-965c-45f7-b337-cbf823c0f0f5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:26.147943 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-362505e1-8d3d-48c4-b027-e25d153de7c4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:26.177421 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-362505e1-8d3d-48c4-b027-e25d153de7c4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1678 microversion: 2.1 time: 0.187683 Sep 09 23:25:26.178150 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 275/523] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:25 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:26.291911 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0a1be4e9-965c-45f7-b337-cbf823c0f0f5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:26.300394 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0a1be4e9-965c-45f7-b337-cbf823c0f0f5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.193309 Sep 09 23:25:26.300968 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 249/524] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:26 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:26.346800 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a88351c6-b6bd-41bc-925c-27c1f9f5cf71 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:26.347405 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a88351c6-b6bd-41bc-925c-27c1f9f5cf71 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:26.365458 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a88351c6-b6bd-41bc-925c-27c1f9f5cf71 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:26.365941 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a88351c6-b6bd-41bc-925c-27c1f9f5cf71 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:26.366401 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a88351c6-b6bd-41bc-925c-27c1f9f5cf71 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:26.367106 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a88351c6-b6bd-41bc-925c-27c1f9f5cf71 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:26.367555 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a88351c6-b6bd-41bc-925c-27c1f9f5cf71 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:26.367990 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a88351c6-b6bd-41bc-925c-27c1f9f5cf71 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:26.498122 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a88351c6-b6bd-41bc-925c-27c1f9f5cf71 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:26.507204 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a88351c6-b6bd-41bc-925c-27c1f9f5cf71 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.164284 Sep 09 23:25:26.507766 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 276/525] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:26 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:26.615185 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-bb427b9f-f96e-46dc-b3c3-1eb2c08e56db tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:26.615733 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-bb427b9f-f96e-46dc-b3c3-1eb2c08e56db tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:26.621611 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bb427b9f-f96e-46dc-b3c3-1eb2c08e56db tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:26.622086 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bb427b9f-f96e-46dc-b3c3-1eb2c08e56db tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:26.622557 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bb427b9f-f96e-46dc-b3c3-1eb2c08e56db tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:26.623238 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bb427b9f-f96e-46dc-b3c3-1eb2c08e56db tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:26.624305 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bb427b9f-f96e-46dc-b3c3-1eb2c08e56db tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:26.624727 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bb427b9f-f96e-46dc-b3c3-1eb2c08e56db tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:26.758277 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bb427b9f-f96e-46dc-b3c3-1eb2c08e56db tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:26.767056 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bb427b9f-f96e-46dc-b3c3-1eb2c08e56db tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:26.768530 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bb427b9f-f96e-46dc-b3c3-1eb2c08e56db tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:26.769697 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-bb427b9f-f96e-46dc-b3c3-1eb2c08e56db tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.158525 Sep 09 23:25:26.770255 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 250/526] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:26 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:27.204843 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0235149f-df68-425b-90e4-3ab216d0a478 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:27.205476 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-0235149f-df68-425b-90e4-3ab216d0a478 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:27.211485 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0235149f-df68-425b-90e4-3ab216d0a478 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:27.211970 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0235149f-df68-425b-90e4-3ab216d0a478 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:27.212407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0235149f-df68-425b-90e4-3ab216d0a478 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:27.213091 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0235149f-df68-425b-90e4-3ab216d0a478 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:27.213548 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0235149f-df68-425b-90e4-3ab216d0a478 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:27.213975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0235149f-df68-425b-90e4-3ab216d0a478 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:27.323947 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-d7c52ec9-d75e-4f4a-9195-fea1725f19bb tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:27.324631 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-d7c52ec9-d75e-4f4a-9195-fea1725f19bb tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:27.332040 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d7c52ec9-d75e-4f4a-9195-fea1725f19bb tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:27.332576 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d7c52ec9-d75e-4f4a-9195-fea1725f19bb tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:27.339811 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d7c52ec9-d75e-4f4a-9195-fea1725f19bb tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:27.339811 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d7c52ec9-d75e-4f4a-9195-fea1725f19bb tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:27.339811 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d7c52ec9-d75e-4f4a-9195-fea1725f19bb tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:27.339811 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d7c52ec9-d75e-4f4a-9195-fea1725f19bb tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:27.341420 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-0235149f-df68-425b-90e4-3ab216d0a478 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:27.354510 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-0235149f-df68-425b-90e4-3ab216d0a478 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1655 microversion: 2.1 time: 0.153440 Sep 09 23:25:27.355098 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 277/527] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:27 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:27.380310 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a3529d46-91bb-492b-bd50-29679a10ffc0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:25:27.386764 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a3529d46-91bb-492b-bd50-29679a10ffc0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:27.387192 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a3529d46-91bb-492b-bd50-29679a10ffc0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:27.387631 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a3529d46-91bb-492b-bd50-29679a10ffc0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:27.411880 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a3529d46-91bb-492b-bd50-29679a10ffc0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Going to try to start instance {{(pid=121059) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 23:25:27.476418 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d7c52ec9-d75e-4f4a-9195-fea1725f19bb tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:27.484551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-d7c52ec9-d75e-4f4a-9195-fea1725f19bb tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.164518 Sep 09 23:25:27.487421 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 251/528] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:27 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:27.532091 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-70ec368f-4710-400c-8bf7-ed8727e9c124 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:27.532733 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-70ec368f-4710-400c-8bf7-ed8727e9c124 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:27.538697 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-70ec368f-4710-400c-8bf7-ed8727e9c124 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:27.540402 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-70ec368f-4710-400c-8bf7-ed8727e9c124 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:27.540402 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-70ec368f-4710-400c-8bf7-ed8727e9c124 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:27.540402 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-70ec368f-4710-400c-8bf7-ed8727e9c124 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:27.540892 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-70ec368f-4710-400c-8bf7-ed8727e9c124 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:27.541326 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-70ec368f-4710-400c-8bf7-ed8727e9c124 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:27.565271 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a3529d46-91bb-492b-bd50-29679a10ffc0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "POST /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/action" status: 202 len: 0 microversion: 2.1 time: 0.188498 Sep 09 23:25:27.565868 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 278/529] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 23:25:27 2022] POST /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 23:25:27.575524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-dddb4cb1-da70-414c-8dc7-cc891256bab7 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:27.577100 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-dddb4cb1-da70-414c-8dc7-cc891256bab7 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:27.583543 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dddb4cb1-da70-414c-8dc7-cc891256bab7 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:27.584032 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dddb4cb1-da70-414c-8dc7-cc891256bab7 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:27.584473 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dddb4cb1-da70-414c-8dc7-cc891256bab7 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:27.585176 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dddb4cb1-da70-414c-8dc7-cc891256bab7 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:27.587472 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dddb4cb1-da70-414c-8dc7-cc891256bab7 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:27.587472 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dddb4cb1-da70-414c-8dc7-cc891256bab7 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:27.674601 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-70ec368f-4710-400c-8bf7-ed8727e9c124 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:27.683183 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-70ec368f-4710-400c-8bf7-ed8727e9c124 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.155167 Sep 09 23:25:27.683801 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 252/530] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:27 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:27.721850 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-dddb4cb1-da70-414c-8dc7-cc891256bab7 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:27.729693 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-dddb4cb1-da70-414c-8dc7-cc891256bab7 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1664 microversion: 2.1 time: 0.158384 Sep 09 23:25:27.730198 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 279/531] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:27 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:27.796430 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8143d894-53df-4298-afa0-caeddf7e920e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:27.797037 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8143d894-53df-4298-afa0-caeddf7e920e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:27.803023 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8143d894-53df-4298-afa0-caeddf7e920e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:27.803498 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8143d894-53df-4298-afa0-caeddf7e920e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:27.803931 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8143d894-53df-4298-afa0-caeddf7e920e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:27.804622 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8143d894-53df-4298-afa0-caeddf7e920e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:27.805057 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8143d894-53df-4298-afa0-caeddf7e920e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:27.805478 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8143d894-53df-4298-afa0-caeddf7e920e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:27.935350 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8143d894-53df-4298-afa0-caeddf7e920e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:27.943873 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8143d894-53df-4298-afa0-caeddf7e920e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:27.945289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8143d894-53df-4298-afa0-caeddf7e920e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:27.946454 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8143d894-53df-4298-afa0-caeddf7e920e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.154533 Sep 09 23:25:27.947007 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 253/532] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:27 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:25:28.508095 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-998d31ac-cefe-4653-ad4f-575b8a155b56 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:28.508712 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-998d31ac-cefe-4653-ad4f-575b8a155b56 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:28.515198 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-998d31ac-cefe-4653-ad4f-575b8a155b56 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:28.515683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-998d31ac-cefe-4653-ad4f-575b8a155b56 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:28.516124 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-998d31ac-cefe-4653-ad4f-575b8a155b56 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:28.516822 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-998d31ac-cefe-4653-ad4f-575b8a155b56 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:28.517281 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-998d31ac-cefe-4653-ad4f-575b8a155b56 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:28.517710 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-998d31ac-cefe-4653-ad4f-575b8a155b56 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:28.643026 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-998d31ac-cefe-4653-ad4f-575b8a155b56 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:28.650793 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-998d31ac-cefe-4653-ad4f-575b8a155b56 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.146442 Sep 09 23:25:28.651302 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 280/533] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:28 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:28.708072 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5544ecd8-6547-4073-b18a-cc1c2f815aa1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:28.708686 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5544ecd8-6547-4073-b18a-cc1c2f815aa1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:28.715400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5544ecd8-6547-4073-b18a-cc1c2f815aa1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:28.715889 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5544ecd8-6547-4073-b18a-cc1c2f815aa1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:28.716326 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5544ecd8-6547-4073-b18a-cc1c2f815aa1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:28.718056 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5544ecd8-6547-4073-b18a-cc1c2f815aa1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:28.718192 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5544ecd8-6547-4073-b18a-cc1c2f815aa1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:28.719109 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5544ecd8-6547-4073-b18a-cc1c2f815aa1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:28.752902 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1bbc4625-9aff-49c9-8272-f4d52b0e38a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:28.753504 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1bbc4625-9aff-49c9-8272-f4d52b0e38a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:28.759391 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1bbc4625-9aff-49c9-8272-f4d52b0e38a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:28.759873 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1bbc4625-9aff-49c9-8272-f4d52b0e38a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:28.760307 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1bbc4625-9aff-49c9-8272-f4d52b0e38a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:28.760992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1bbc4625-9aff-49c9-8272-f4d52b0e38a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:28.761443 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1bbc4625-9aff-49c9-8272-f4d52b0e38a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:28.761862 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1bbc4625-9aff-49c9-8272-f4d52b0e38a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:28.859168 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5544ecd8-6547-4073-b18a-cc1c2f815aa1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:28.867293 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5544ecd8-6547-4073-b18a-cc1c2f815aa1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.163025 Sep 09 23:25:28.867871 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 254/534] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:28 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:28.894830 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1bbc4625-9aff-49c9-8272-f4d52b0e38a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:28.902495 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1bbc4625-9aff-49c9-8272-f4d52b0e38a8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1664 microversion: 2.1 time: 0.153304 Sep 09 23:25:28.902997 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 281/535] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:28 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:28.974010 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-04ab0d80-e45b-47a7-9899-25b43b143089 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:28.974648 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-04ab0d80-e45b-47a7-9899-25b43b143089 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:28.980473 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-04ab0d80-e45b-47a7-9899-25b43b143089 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:28.980950 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-04ab0d80-e45b-47a7-9899-25b43b143089 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:28.981383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-04ab0d80-e45b-47a7-9899-25b43b143089 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:28.982097 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-04ab0d80-e45b-47a7-9899-25b43b143089 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:28.982628 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-04ab0d80-e45b-47a7-9899-25b43b143089 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:28.983083 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-04ab0d80-e45b-47a7-9899-25b43b143089 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:29.115175 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-04ab0d80-e45b-47a7-9899-25b43b143089 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:29.124290 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-04ab0d80-e45b-47a7-9899-25b43b143089 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:29.125730 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-04ab0d80-e45b-47a7-9899-25b43b143089 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:29.126916 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-04ab0d80-e45b-47a7-9899-25b43b143089 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.156810 Sep 09 23:25:29.127475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 255/536] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:28 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:29.675081 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c9b86dc2-db2e-4191-a172-c3587c292a86 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:29.675644 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-c9b86dc2-db2e-4191-a172-c3587c292a86 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:29.682007 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c9b86dc2-db2e-4191-a172-c3587c292a86 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:29.682522 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c9b86dc2-db2e-4191-a172-c3587c292a86 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:29.682952 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c9b86dc2-db2e-4191-a172-c3587c292a86 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:29.683629 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c9b86dc2-db2e-4191-a172-c3587c292a86 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:29.684080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c9b86dc2-db2e-4191-a172-c3587c292a86 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:29.684498 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c9b86dc2-db2e-4191-a172-c3587c292a86 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:29.812683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-c9b86dc2-db2e-4191-a172-c3587c292a86 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:29.820124 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-c9b86dc2-db2e-4191-a172-c3587c292a86 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.148978 Sep 09 23:25:29.820685 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 282/537] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:29 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:29.891527 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0dba0331-3a1e-402d-b239-b094b93eeb9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:29.892136 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0dba0331-3a1e-402d-b239-b094b93eeb9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:29.898398 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0dba0331-3a1e-402d-b239-b094b93eeb9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:29.898879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0dba0331-3a1e-402d-b239-b094b93eeb9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:29.899341 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0dba0331-3a1e-402d-b239-b094b93eeb9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:29.900022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0dba0331-3a1e-402d-b239-b094b93eeb9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:29.900474 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0dba0331-3a1e-402d-b239-b094b93eeb9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:29.900900 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0dba0331-3a1e-402d-b239-b094b93eeb9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:29.925556 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d22f48ae-5ac2-44df-984c-aaafe8e2b777 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:29.926092 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d22f48ae-5ac2-44df-984c-aaafe8e2b777 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:29.931948 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d22f48ae-5ac2-44df-984c-aaafe8e2b777 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:29.932429 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d22f48ae-5ac2-44df-984c-aaafe8e2b777 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:29.932861 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d22f48ae-5ac2-44df-984c-aaafe8e2b777 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:29.933548 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d22f48ae-5ac2-44df-984c-aaafe8e2b777 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:29.934001 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d22f48ae-5ac2-44df-984c-aaafe8e2b777 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:29.934521 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d22f48ae-5ac2-44df-984c-aaafe8e2b777 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:30.039047 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0dba0331-3a1e-402d-b239-b094b93eeb9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:30.047937 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0dba0331-3a1e-402d-b239-b094b93eeb9e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.160175 Sep 09 23:25:30.048510 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 256/538] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:29 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:30.068663 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d22f48ae-5ac2-44df-984c-aaafe8e2b777 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:30.076230 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d22f48ae-5ac2-44df-984c-aaafe8e2b777 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1664 microversion: 2.1 time: 0.154588 Sep 09 23:25:30.077371 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 283/539] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:29 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:30.153385 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a621594b-26a6-4644-8a34-e9a0a688ed5b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:30.153991 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a621594b-26a6-4644-8a34-e9a0a688ed5b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:30.160494 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a621594b-26a6-4644-8a34-e9a0a688ed5b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:30.160975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a621594b-26a6-4644-8a34-e9a0a688ed5b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:30.161411 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a621594b-26a6-4644-8a34-e9a0a688ed5b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:30.162098 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a621594b-26a6-4644-8a34-e9a0a688ed5b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:30.162576 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a621594b-26a6-4644-8a34-e9a0a688ed5b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:30.163002 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a621594b-26a6-4644-8a34-e9a0a688ed5b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:30.299510 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a621594b-26a6-4644-8a34-e9a0a688ed5b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:30.308035 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a621594b-26a6-4644-8a34-e9a0a688ed5b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:30.309470 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a621594b-26a6-4644-8a34-e9a0a688ed5b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:30.310720 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a621594b-26a6-4644-8a34-e9a0a688ed5b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.161121 Sep 09 23:25:30.312210 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 257/540] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:30 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:30.843541 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-6db5a06c-df41-4b3e-a971-a6ebc1cca449 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:30.844150 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-6db5a06c-df41-4b3e-a971-a6ebc1cca449 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:30.853539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6db5a06c-df41-4b3e-a971-a6ebc1cca449 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:30.854024 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6db5a06c-df41-4b3e-a971-a6ebc1cca449 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:30.855677 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6db5a06c-df41-4b3e-a971-a6ebc1cca449 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:30.856440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6db5a06c-df41-4b3e-a971-a6ebc1cca449 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:30.856899 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6db5a06c-df41-4b3e-a971-a6ebc1cca449 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:30.857341 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6db5a06c-df41-4b3e-a971-a6ebc1cca449 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:30.862600 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:25:31.013765 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-6db5a06c-df41-4b3e-a971-a6ebc1cca449 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:31.022691 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-6db5a06c-df41-4b3e-a971-a6ebc1cca449 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.183994 Sep 09 23:25:31.023373 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 284/541] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:30 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:31.074419 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-24587d35-4776-406f-b7ae-8760dddf2547 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:31.075485 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-24587d35-4776-406f-b7ae-8760dddf2547 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:31.084100 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-24587d35-4776-406f-b7ae-8760dddf2547 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:31.084593 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-24587d35-4776-406f-b7ae-8760dddf2547 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:31.085021 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-24587d35-4776-406f-b7ae-8760dddf2547 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:31.085760 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-24587d35-4776-406f-b7ae-8760dddf2547 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:31.086221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-24587d35-4776-406f-b7ae-8760dddf2547 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:31.090762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-24587d35-4776-406f-b7ae-8760dddf2547 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:31.104067 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-718ff69d-4020-416f-a5fb-4c6e62ce6425 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:31.105089 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-718ff69d-4020-416f-a5fb-4c6e62ce6425 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:31.115632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-718ff69d-4020-416f-a5fb-4c6e62ce6425 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:31.116451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-718ff69d-4020-416f-a5fb-4c6e62ce6425 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:31.117178 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-718ff69d-4020-416f-a5fb-4c6e62ce6425 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:31.118331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-718ff69d-4020-416f-a5fb-4c6e62ce6425 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:31.119128 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-718ff69d-4020-416f-a5fb-4c6e62ce6425 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:31.119729 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-718ff69d-4020-416f-a5fb-4c6e62ce6425 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:31.262821 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-24587d35-4776-406f-b7ae-8760dddf2547 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:31.271994 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-24587d35-4776-406f-b7ae-8760dddf2547 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.203442 Sep 09 23:25:31.272592 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 258/542] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:31 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:31.337423 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-179a00f6-2276-449c-868a-27868d009a67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:31.338053 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-179a00f6-2276-449c-868a-27868d009a67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:31.344805 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-179a00f6-2276-449c-868a-27868d009a67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:31.345301 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-179a00f6-2276-449c-868a-27868d009a67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:31.345749 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-179a00f6-2276-449c-868a-27868d009a67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:31.346495 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-179a00f6-2276-449c-868a-27868d009a67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:31.346955 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-179a00f6-2276-449c-868a-27868d009a67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:31.347390 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-179a00f6-2276-449c-868a-27868d009a67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:31.487859 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-179a00f6-2276-449c-868a-27868d009a67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:31.496051 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-179a00f6-2276-449c-868a-27868d009a67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:31.497483 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-179a00f6-2276-449c-868a-27868d009a67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:31.499020 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-179a00f6-2276-449c-868a-27868d009a67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.165540 Sep 09 23:25:31.499590 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 259/543] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:31 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:25:31.518886 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-718ff69d-4020-416f-a5fb-4c6e62ce6425 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:31.526798 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-718ff69d-4020-416f-a5fb-4c6e62ce6425 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1664 microversion: 2.1 time: 0.429579 Sep 09 23:25:31.527357 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 285/544] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:31 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1664 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:32.048255 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-29949e79-c046-43cf-919c-52b1f2ef0d7d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:32.048859 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-29949e79-c046-43cf-919c-52b1f2ef0d7d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:32.054897 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-29949e79-c046-43cf-919c-52b1f2ef0d7d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:32.055383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-29949e79-c046-43cf-919c-52b1f2ef0d7d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:32.055825 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-29949e79-c046-43cf-919c-52b1f2ef0d7d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:32.056610 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-29949e79-c046-43cf-919c-52b1f2ef0d7d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:32.057071 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-29949e79-c046-43cf-919c-52b1f2ef0d7d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:32.057499 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-29949e79-c046-43cf-919c-52b1f2ef0d7d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:32.229578 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-29949e79-c046-43cf-919c-52b1f2ef0d7d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:32.238485 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-29949e79-c046-43cf-919c-52b1f2ef0d7d tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.194801 Sep 09 23:25:32.239069 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 260/545] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:32 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:32.297950 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-33ed6de0-a9db-4f6e-9e38-4b5416d5a36a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:32.298586 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-33ed6de0-a9db-4f6e-9e38-4b5416d5a36a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:32.306168 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-33ed6de0-a9db-4f6e-9e38-4b5416d5a36a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:32.306949 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-33ed6de0-a9db-4f6e-9e38-4b5416d5a36a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:32.307630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-33ed6de0-a9db-4f6e-9e38-4b5416d5a36a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:32.308598 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-33ed6de0-a9db-4f6e-9e38-4b5416d5a36a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:32.309628 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-33ed6de0-a9db-4f6e-9e38-4b5416d5a36a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:32.310305 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-33ed6de0-a9db-4f6e-9e38-4b5416d5a36a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:32.512245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-33ed6de0-a9db-4f6e-9e38-4b5416d5a36a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:32.523513 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-33ed6de0-a9db-4f6e-9e38-4b5416d5a36a tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1734 microversion: 2.1 time: 0.230788 Sep 09 23:25:32.524187 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 286/546] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:32 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1734 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:32.525392 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-39fdbbf4-3411-4324-8ac1-2d82e227221a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:32.526008 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-39fdbbf4-3411-4324-8ac1-2d82e227221a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:32.532805 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39fdbbf4-3411-4324-8ac1-2d82e227221a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:32.533335 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39fdbbf4-3411-4324-8ac1-2d82e227221a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:32.534355 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39fdbbf4-3411-4324-8ac1-2d82e227221a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:32.535057 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39fdbbf4-3411-4324-8ac1-2d82e227221a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:32.535513 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39fdbbf4-3411-4324-8ac1-2d82e227221a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:32.535950 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39fdbbf4-3411-4324-8ac1-2d82e227221a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:32.538514 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=100 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:25:32.550758 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-2b1a2060-8ae5-4c3c-a8b7-80986d5e207b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:32.551401 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-2b1a2060-8ae5-4c3c-a8b7-80986d5e207b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:32.557349 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b1a2060-8ae5-4c3c-a8b7-80986d5e207b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:32.564527 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b1a2060-8ae5-4c3c-a8b7-80986d5e207b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:32.564527 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b1a2060-8ae5-4c3c-a8b7-80986d5e207b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:32.564527 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b1a2060-8ae5-4c3c-a8b7-80986d5e207b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:32.564527 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b1a2060-8ae5-4c3c-a8b7-80986d5e207b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:32.565102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b1a2060-8ae5-4c3c-a8b7-80986d5e207b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:32.670006 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-39fdbbf4-3411-4324-8ac1-2d82e227221a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:32.678816 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-39fdbbf4-3411-4324-8ac1-2d82e227221a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:32.680313 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-39fdbbf4-3411-4324-8ac1-2d82e227221a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:32.681474 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-39fdbbf4-3411-4324-8ac1-2d82e227221a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.159954 Sep 09 23:25:32.682037 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 261/547] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:32 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:25:32.692292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-2b1a2060-8ae5-4c3c-a8b7-80986d5e207b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:32.700163 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-2b1a2060-8ae5-4c3c-a8b7-80986d5e207b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1664 microversion: 2.1 time: 0.153565 Sep 09 23:25:32.701859 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 287/548] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:32 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:33.266194 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-f6c9251f-604e-4c0d-82b5-516347a23c34 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:33.266833 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-f6c9251f-604e-4c0d-82b5-516347a23c34 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:33.274423 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f6c9251f-604e-4c0d-82b5-516347a23c34 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:33.274913 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f6c9251f-604e-4c0d-82b5-516347a23c34 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:33.275349 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f6c9251f-604e-4c0d-82b5-516347a23c34 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:33.276113 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f6c9251f-604e-4c0d-82b5-516347a23c34 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:33.276570 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f6c9251f-604e-4c0d-82b5-516347a23c34 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:33.276993 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f6c9251f-604e-4c0d-82b5-516347a23c34 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:33.414608 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-f6c9251f-604e-4c0d-82b5-516347a23c34 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:33.423627 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-f6c9251f-604e-4c0d-82b5-516347a23c34 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.161279 Sep 09 23:25:33.424206 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 262/549] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:33 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:33.550810 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f71cd8de-b271-434b-a82a-78ca0a05a560 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:33.551514 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f71cd8de-b271-434b-a82a-78ca0a05a560 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:33.557863 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f71cd8de-b271-434b-a82a-78ca0a05a560 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:33.558359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f71cd8de-b271-434b-a82a-78ca0a05a560 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:33.558801 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f71cd8de-b271-434b-a82a-78ca0a05a560 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:33.559493 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f71cd8de-b271-434b-a82a-78ca0a05a560 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:33.559944 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f71cd8de-b271-434b-a82a-78ca0a05a560 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:33.560366 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f71cd8de-b271-434b-a82a-78ca0a05a560 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:33.708485 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-31401f70-7bec-421b-a6e2-5b82252df105 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:33.711780 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-31401f70-7bec-421b-a6e2-5b82252df105 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:33.715193 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-31401f70-7bec-421b-a6e2-5b82252df105 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:33.715673 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-31401f70-7bec-421b-a6e2-5b82252df105 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:33.716108 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-31401f70-7bec-421b-a6e2-5b82252df105 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:33.716790 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-31401f70-7bec-421b-a6e2-5b82252df105 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:33.717269 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-31401f70-7bec-421b-a6e2-5b82252df105 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:33.717784 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-31401f70-7bec-421b-a6e2-5b82252df105 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:33.730995 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f71cd8de-b271-434b-a82a-78ca0a05a560 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:33.741951 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f71cd8de-b271-434b-a82a-78ca0a05a560 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1714 microversion: 2.1 time: 0.194893 Sep 09 23:25:33.742722 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 288/550] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:33 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1714 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:33.754944 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-231dbc67-1e81-4c39-bc89-f2aced5afdb0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:33.754944 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-231dbc67-1e81-4c39-bc89-f2aced5afdb0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:33.754944 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-231dbc67-1e81-4c39-bc89-f2aced5afdb0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:33.755519 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-231dbc67-1e81-4c39-bc89-f2aced5afdb0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:33.756113 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-231dbc67-1e81-4c39-bc89-f2aced5afdb0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:33.756840 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-231dbc67-1e81-4c39-bc89-f2aced5afdb0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:33.757419 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-231dbc67-1e81-4c39-bc89-f2aced5afdb0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:33.757937 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-231dbc67-1e81-4c39-bc89-f2aced5afdb0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:33.881278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-31401f70-7bec-421b-a6e2-5b82252df105 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:33.895310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-31401f70-7bec-421b-a6e2-5b82252df105 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:33.901826 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-31401f70-7bec-421b-a6e2-5b82252df105 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:33.901826 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-31401f70-7bec-421b-a6e2-5b82252df105 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.193514 Sep 09 23:25:33.901826 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 263/551] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:33 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:25:33.903914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-43ab9d2b-cb6f-4384-a309-6b01a1fdf437 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:33.904584 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-43ab9d2b-cb6f-4384-a309-6b01a1fdf437 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:33.911084 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43ab9d2b-cb6f-4384-a309-6b01a1fdf437 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:33.911685 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43ab9d2b-cb6f-4384-a309-6b01a1fdf437 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:33.912280 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43ab9d2b-cb6f-4384-a309-6b01a1fdf437 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:33.913071 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43ab9d2b-cb6f-4384-a309-6b01a1fdf437 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:33.913798 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43ab9d2b-cb6f-4384-a309-6b01a1fdf437 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:33.914520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43ab9d2b-cb6f-4384-a309-6b01a1fdf437 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:33.944895 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-231dbc67-1e81-4c39-bc89-f2aced5afdb0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:33.959515 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-231dbc67-1e81-4c39-bc89-f2aced5afdb0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1664 microversion: 2.1 time: 0.211266 Sep 09 23:25:33.959515 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 289/552] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:33 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1664 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:34.009562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-43ab9d2b-cb6f-4384-a309-6b01a1fdf437 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] HTTP exception thrown: Cannot 'detach_volume' instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff while it is in vm_state rescued Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-43ab9d2b-cb6f-4384-a309-6b01a1fdf437 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Request method failure captured: Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: DELETE /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-volume_attachments/2dee8f47-6a63-4ba4-870e-71db6f3e12e5 HTTP/1.1 Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8pvNjLzJ26L_bDfYD8jco5ncLw5obm7RC4wRKucPyVFopv8LyYjnV_yhQPQAMGp6Zil82MDNt-pAuesw1hNYtsUzcK3dtyAhtCRZHB6fsXyFIBBtemCyksfm8yeHS53wmAq7bbGmXxhGwRUbZisQhpK4e3SQrT2dZnXAXnSUbLamlo Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 57759aec45f74a689727fca5fe201e40 Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-180796804 Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:25:34.011214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:25:34.012870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57759aec45f74a689727fca5fe201e40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57759aec45f74a689727fca5fe201e40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57759aec45f74a689727fca5fe201e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57759aec45f74a689727fca5fe201e40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:25:34.012870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-ServerRescueNegativeTestJSON-180796804 Sep 09 23:25:34.012870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 57759aec45f74a689727fca5fe201e40 Sep 09 23:25:34.012870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-180796804 Sep 09 23:25:34.012870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-ServerRescueNegativeTestJSON-180796804-project Sep 09 23:25:34.012870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:25:34.012870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:25:34.012870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 987d2f6bb1ff4f1fa248c3ff410c8119 Sep 09 23:25:34.012870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-ServerRescueNegativeTestJSON-180796804-project Sep 09 23:25:34.012870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:25:34.012870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Cannot 'detach_volume' instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff while it is in vm_state rescued Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'server_id': '8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff', 'id': '2dee8f47-6a63-4ba4-870e-71db6f3e12e5'} Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:25:34.015139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff while it is in vm_state rescued Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff while it is in vm_state rescued Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:25:34.016758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-43ab9d2b-cb6f-4384-a309-6b01a1fdf437 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Returning 409 to user: Cannot 'detach_volume' instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff while it is in vm_state rescued {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:25:34.017913 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-43ab9d2b-cb6f-4384-a309-6b01a1fdf437 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-volume_attachments/2dee8f47-6a63-4ba4-870e-71db6f3e12e5" status: 409 len: 152 microversion: 2.1 time: 0.113111 Sep 09 23:25:34.017913 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 264/553] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 23:25:33 2022] DELETE /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-volume_attachments/2dee8f47-6a63-4ba4-870e-71db6f3e12e5 => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 23:25:34.022518 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f3417b07-9337-469c-b16f-adbf40192742 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:25:34.027954 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f3417b07-9337-469c-b16f-adbf40192742 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:34.029166 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f3417b07-9337-469c-b16f-adbf40192742 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:34.029763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f3417b07-9337-469c-b16f-adbf40192742 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:34.030195 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f3417b07-9337-469c-b16f-adbf40192742 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:34.031066 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f3417b07-9337-469c-b16f-adbf40192742 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:34.031523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f3417b07-9337-469c-b16f-adbf40192742 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:34.031940 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f3417b07-9337-469c-b16f-adbf40192742 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:34.330926 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f3417b07-9337-469c-b16f-adbf40192742 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "POST /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/action" status: 202 len: 0 microversion: 2.1 time: 0.312215 Sep 09 23:25:34.331572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 290/554] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 23:25:34 2022] POST /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:25:34.339837 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5390bb3b-1512-491d-ae6e-b0b4de0feee8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:34.340474 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5390bb3b-1512-491d-ae6e-b0b4de0feee8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:34.348072 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5390bb3b-1512-491d-ae6e-b0b4de0feee8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:34.348554 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5390bb3b-1512-491d-ae6e-b0b4de0feee8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:34.348985 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5390bb3b-1512-491d-ae6e-b0b4de0feee8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:34.349711 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5390bb3b-1512-491d-ae6e-b0b4de0feee8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:34.350164 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5390bb3b-1512-491d-ae6e-b0b4de0feee8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:34.350634 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5390bb3b-1512-491d-ae6e-b0b4de0feee8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:34.447628 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5d03decb-95fc-447f-9863-e429a22d9ad5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:34.448537 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5d03decb-95fc-447f-9863-e429a22d9ad5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:34.457266 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d03decb-95fc-447f-9863-e429a22d9ad5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:34.457754 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d03decb-95fc-447f-9863-e429a22d9ad5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:34.458216 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d03decb-95fc-447f-9863-e429a22d9ad5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:34.458896 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d03decb-95fc-447f-9863-e429a22d9ad5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:34.465934 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d03decb-95fc-447f-9863-e429a22d9ad5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:34.468212 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d03decb-95fc-447f-9863-e429a22d9ad5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:34.500341 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5390bb3b-1512-491d-ae6e-b0b4de0feee8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:34.509056 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5390bb3b-1512-491d-ae6e-b0b4de0feee8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1722 microversion: 2.1 time: 0.173014 Sep 09 23:25:34.509716 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 265/555] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:34 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:34.606315 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5d03decb-95fc-447f-9863-e429a22d9ad5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:34.615587 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5d03decb-95fc-447f-9863-e429a22d9ad5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.173012 Sep 09 23:25:34.616316 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 291/556] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:34 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:34.926470 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-cc6a224a-e9ee-48ea-8a92-283069e6797a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:34.927104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-cc6a224a-e9ee-48ea-8a92-283069e6797a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:34.932998 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cc6a224a-e9ee-48ea-8a92-283069e6797a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:34.933658 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cc6a224a-e9ee-48ea-8a92-283069e6797a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:34.934097 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cc6a224a-e9ee-48ea-8a92-283069e6797a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:34.934811 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cc6a224a-e9ee-48ea-8a92-283069e6797a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:34.935263 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cc6a224a-e9ee-48ea-8a92-283069e6797a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:34.935769 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cc6a224a-e9ee-48ea-8a92-283069e6797a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:34.979370 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-da6b477a-666a-4a90-98f5-2c287ca3e570 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:34.979976 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-da6b477a-666a-4a90-98f5-2c287ca3e570 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:34.986811 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-da6b477a-666a-4a90-98f5-2c287ca3e570 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:34.987292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-da6b477a-666a-4a90-98f5-2c287ca3e570 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:34.987763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-da6b477a-666a-4a90-98f5-2c287ca3e570 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:34.988676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-da6b477a-666a-4a90-98f5-2c287ca3e570 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:34.989133 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-da6b477a-666a-4a90-98f5-2c287ca3e570 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:34.989583 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-da6b477a-666a-4a90-98f5-2c287ca3e570 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:35.070864 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-cc6a224a-e9ee-48ea-8a92-283069e6797a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:35.081909 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-cc6a224a-e9ee-48ea-8a92-283069e6797a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:35.082819 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-cc6a224a-e9ee-48ea-8a92-283069e6797a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:35.084283 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-cc6a224a-e9ee-48ea-8a92-283069e6797a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.161676 Sep 09 23:25:35.085014 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 266/557] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:34 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:35.131228 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-da6b477a-666a-4a90-98f5-2c287ca3e570 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:35.139793 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-da6b477a-666a-4a90-98f5-2c287ca3e570 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1668 microversion: 2.1 time: 0.163833 Sep 09 23:25:35.140362 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 292/558] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:34 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:35.533452 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-93c25abf-cfc0-41c0-bdb3-e74640d992cd tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:35.534696 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-93c25abf-cfc0-41c0-bdb3-e74640d992cd tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:35.541269 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-93c25abf-cfc0-41c0-bdb3-e74640d992cd tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:35.541756 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-93c25abf-cfc0-41c0-bdb3-e74640d992cd tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:35.542265 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-93c25abf-cfc0-41c0-bdb3-e74640d992cd tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:35.543003 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-93c25abf-cfc0-41c0-bdb3-e74640d992cd tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:35.543457 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-93c25abf-cfc0-41c0-bdb3-e74640d992cd tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:35.543885 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-93c25abf-cfc0-41c0-bdb3-e74640d992cd tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:35.639369 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5ac99152-80ae-4359-a4ec-a8ea7e27e900 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:35.640129 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5ac99152-80ae-4359-a4ec-a8ea7e27e900 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:35.646888 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5ac99152-80ae-4359-a4ec-a8ea7e27e900 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:35.647472 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5ac99152-80ae-4359-a4ec-a8ea7e27e900 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:35.647911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5ac99152-80ae-4359-a4ec-a8ea7e27e900 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:35.648613 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5ac99152-80ae-4359-a4ec-a8ea7e27e900 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:35.649069 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5ac99152-80ae-4359-a4ec-a8ea7e27e900 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:35.649594 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5ac99152-80ae-4359-a4ec-a8ea7e27e900 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:35.685391 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-93c25abf-cfc0-41c0-bdb3-e74640d992cd tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:35.694110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-93c25abf-cfc0-41c0-bdb3-e74640d992cd tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1722 microversion: 2.1 time: 0.164872 Sep 09 23:25:35.694796 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 267/559] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:35 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:35.925995 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5ac99152-80ae-4359-a4ec-a8ea7e27e900 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:35.934899 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5ac99152-80ae-4359-a4ec-a8ea7e27e900 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.299989 Sep 09 23:25:35.935475 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 293/560] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:35 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:36.110618 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3482808d-9de3-4113-adf6-1269f2e8a0bd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:36.111231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3482808d-9de3-4113-adf6-1269f2e8a0bd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:36.117787 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3482808d-9de3-4113-adf6-1269f2e8a0bd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:36.118256 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3482808d-9de3-4113-adf6-1269f2e8a0bd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:36.118744 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3482808d-9de3-4113-adf6-1269f2e8a0bd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:36.119517 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3482808d-9de3-4113-adf6-1269f2e8a0bd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:36.120044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3482808d-9de3-4113-adf6-1269f2e8a0bd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:36.120622 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3482808d-9de3-4113-adf6-1269f2e8a0bd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:36.271286 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3482808d-9de3-4113-adf6-1269f2e8a0bd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:36.280236 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3482808d-9de3-4113-adf6-1269f2e8a0bd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:36.281692 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3482808d-9de3-4113-adf6-1269f2e8a0bd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:36.282906 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3482808d-9de3-4113-adf6-1269f2e8a0bd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.176603 Sep 09 23:25:36.283469 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 268/561] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:36 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:25:36.637585 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-74948188-92ff-427f-a75b-2e0de5f776d5 req-6a94fcf1-d542-4d38-97b2-bfcaebc0c857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b99c3b-e692-4386-bbdf-e3dbc1a304b1", "name": "network-vif-plugged", "status": "completed", "tag": "5607c7a4-9f27-4940-9fd7-0f2ffa9cf82b"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:25:36.649620 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-74948188-92ff-427f-a75b-2e0de5f776d5 req-6a94fcf1-d542-4d38-97b2-bfcaebc0c857 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:36.650272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-74948188-92ff-427f-a75b-2e0de5f776d5 req-6a94fcf1-d542-4d38-97b2-bfcaebc0c857 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:36.650580 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-74948188-92ff-427f-a75b-2e0de5f776d5 req-6a94fcf1-d542-4d38-97b2-bfcaebc0c857 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:36.662607 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-74948188-92ff-427f-a75b-2e0de5f776d5 req-6a94fcf1-d542-4d38-97b2-bfcaebc0c857 service nova] Creating event network-vif-plugged:5607c7a4-9f27-4940-9fd7-0f2ffa9cf82b for instance 28b99c3b-e692-4386-bbdf-e3dbc1a304b1 on hv-cinder-85032 Sep 09 23:25:36.667578 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-74948188-92ff-427f-a75b-2e0de5f776d5 req-6a94fcf1-d542-4d38-97b2-bfcaebc0c857 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033562 Sep 09 23:25:36.668092 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 294/562] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:25:36.725393 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4a09f439-8d29-4d26-a3d7-0c952770929f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:36.725393 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4a09f439-8d29-4d26-a3d7-0c952770929f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:36.730078 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4a09f439-8d29-4d26-a3d7-0c952770929f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:36.730616 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4a09f439-8d29-4d26-a3d7-0c952770929f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:36.731017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4a09f439-8d29-4d26-a3d7-0c952770929f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:36.731943 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4a09f439-8d29-4d26-a3d7-0c952770929f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:36.732436 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4a09f439-8d29-4d26-a3d7-0c952770929f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:36.733989 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4a09f439-8d29-4d26-a3d7-0c952770929f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:36.871086 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4a09f439-8d29-4d26-a3d7-0c952770929f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:36.880645 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4a09f439-8d29-4d26-a3d7-0c952770929f tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1722 microversion: 2.1 time: 0.166967 Sep 09 23:25:36.881212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 269/563] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:36 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:36.960941 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3a7af04d-c29f-4c5a-996d-f34383e3a0e5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:36.961782 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3a7af04d-c29f-4c5a-996d-f34383e3a0e5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:36.969119 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a7af04d-c29f-4c5a-996d-f34383e3a0e5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:36.969610 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a7af04d-c29f-4c5a-996d-f34383e3a0e5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:36.970143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a7af04d-c29f-4c5a-996d-f34383e3a0e5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:36.970917 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a7af04d-c29f-4c5a-996d-f34383e3a0e5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:36.971376 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a7af04d-c29f-4c5a-996d-f34383e3a0e5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:36.971800 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a7af04d-c29f-4c5a-996d-f34383e3a0e5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:37.163309 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3a7af04d-c29f-4c5a-996d-f34383e3a0e5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:37.171465 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3a7af04d-c29f-4c5a-996d-f34383e3a0e5 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.215169 Sep 09 23:25:37.172057 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 295/564] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:36 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:37.308765 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-395ee45f-f15f-4f46-b5e6-4fe05a1f2d9a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:37.309376 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-395ee45f-f15f-4f46-b5e6-4fe05a1f2d9a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:37.316130 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-395ee45f-f15f-4f46-b5e6-4fe05a1f2d9a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:37.316615 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-395ee45f-f15f-4f46-b5e6-4fe05a1f2d9a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:37.317050 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-395ee45f-f15f-4f46-b5e6-4fe05a1f2d9a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:37.317748 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-395ee45f-f15f-4f46-b5e6-4fe05a1f2d9a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:37.318200 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-395ee45f-f15f-4f46-b5e6-4fe05a1f2d9a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:37.318649 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-395ee45f-f15f-4f46-b5e6-4fe05a1f2d9a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:37.564824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-395ee45f-f15f-4f46-b5e6-4fe05a1f2d9a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:37.574624 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-395ee45f-f15f-4f46-b5e6-4fe05a1f2d9a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:37.576481 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-395ee45f-f15f-4f46-b5e6-4fe05a1f2d9a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:37.579015 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-395ee45f-f15f-4f46-b5e6-4fe05a1f2d9a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.274126 Sep 09 23:25:37.579671 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 270/565] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:37 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:37.904880 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0efa61a0-21f5-41cc-a318-48354e5f46d6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:37.906967 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-0efa61a0-21f5-41cc-a318-48354e5f46d6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:37.913438 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0efa61a0-21f5-41cc-a318-48354e5f46d6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:37.913927 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0efa61a0-21f5-41cc-a318-48354e5f46d6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:37.914390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0efa61a0-21f5-41cc-a318-48354e5f46d6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:37.915090 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0efa61a0-21f5-41cc-a318-48354e5f46d6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:37.915545 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0efa61a0-21f5-41cc-a318-48354e5f46d6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:37.916000 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0efa61a0-21f5-41cc-a318-48354e5f46d6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:38.196969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-388c187c-b59f-4bab-9a25-7d28b3e14440 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:38.198155 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-388c187c-b59f-4bab-9a25-7d28b3e14440 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:38.210967 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-0efa61a0-21f5-41cc-a318-48354e5f46d6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:38.216147 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-388c187c-b59f-4bab-9a25-7d28b3e14440 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:38.216737 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-388c187c-b59f-4bab-9a25-7d28b3e14440 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:38.217865 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-388c187c-b59f-4bab-9a25-7d28b3e14440 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:38.218840 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-388c187c-b59f-4bab-9a25-7d28b3e14440 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:38.219304 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-388c187c-b59f-4bab-9a25-7d28b3e14440 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:38.219727 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-388c187c-b59f-4bab-9a25-7d28b3e14440 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:38.225081 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-0efa61a0-21f5-41cc-a318-48354e5f46d6 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1722 microversion: 2.1 time: 0.323818 Sep 09 23:25:38.230437 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 296/566] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:37 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:38.387336 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-388c187c-b59f-4bab-9a25-7d28b3e14440 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:38.396092 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-388c187c-b59f-4bab-9a25-7d28b3e14440 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.205065 Sep 09 23:25:38.402051 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 271/567] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:38 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:38.608700 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-de92f79c-2590-46fe-b52f-c4afec82f2a7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:38.609473 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-de92f79c-2590-46fe-b52f-c4afec82f2a7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:38.616172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-de92f79c-2590-46fe-b52f-c4afec82f2a7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:38.616740 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-de92f79c-2590-46fe-b52f-c4afec82f2a7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:38.617255 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-de92f79c-2590-46fe-b52f-c4afec82f2a7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:38.618031 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-de92f79c-2590-46fe-b52f-c4afec82f2a7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:38.618588 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-de92f79c-2590-46fe-b52f-c4afec82f2a7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:38.619217 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-de92f79c-2590-46fe-b52f-c4afec82f2a7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:38.681408 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-8f9190d2-33d8-4382-9a55-7512c6f84e83 req-2e994dde-d852-45a4-ac4d-ac48c34fea02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a8b2e1-79be-4c0d-b316-94c95ae04638", "name": "network-vif-plugged", "status": "completed", "tag": "a8c73f48-9a44-48f9-9123-64c486486e8b"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:25:38.692694 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-8f9190d2-33d8-4382-9a55-7512c6f84e83 req-2e994dde-d852-45a4-ac4d-ac48c34fea02 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:38.693180 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-8f9190d2-33d8-4382-9a55-7512c6f84e83 req-2e994dde-d852-45a4-ac4d-ac48c34fea02 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:38.693800 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-8f9190d2-33d8-4382-9a55-7512c6f84e83 req-2e994dde-d852-45a4-ac4d-ac48c34fea02 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:38.708391 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-8f9190d2-33d8-4382-9a55-7512c6f84e83 req-2e994dde-d852-45a4-ac4d-ac48c34fea02 service nova] Creating event network-vif-plugged:a8c73f48-9a44-48f9-9123-64c486486e8b for instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 on hv-cinder-85032 Sep 09 23:25:38.713851 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-8f9190d2-33d8-4382-9a55-7512c6f84e83 req-2e994dde-d852-45a4-ac4d-ac48c34fea02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036037 Sep 09 23:25:38.714789 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 272/568] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:25:38.866318 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-de92f79c-2590-46fe-b52f-c4afec82f2a7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:38.877837 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-de92f79c-2590-46fe-b52f-c4afec82f2a7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:38.879678 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-de92f79c-2590-46fe-b52f-c4afec82f2a7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:38.880691 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-de92f79c-2590-46fe-b52f-c4afec82f2a7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.277744 Sep 09 23:25:38.881251 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 297/569] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:38 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:39.249905 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ec0f6fdd-1a81-4e1b-8f2d-66b5ed9cac97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:39.251230 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ec0f6fdd-1a81-4e1b-8f2d-66b5ed9cac97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:39.258426 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec0f6fdd-1a81-4e1b-8f2d-66b5ed9cac97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:39.263422 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec0f6fdd-1a81-4e1b-8f2d-66b5ed9cac97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:39.263422 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec0f6fdd-1a81-4e1b-8f2d-66b5ed9cac97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:39.263422 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec0f6fdd-1a81-4e1b-8f2d-66b5ed9cac97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:39.263422 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec0f6fdd-1a81-4e1b-8f2d-66b5ed9cac97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:39.264399 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec0f6fdd-1a81-4e1b-8f2d-66b5ed9cac97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:39.406192 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ec0f6fdd-1a81-4e1b-8f2d-66b5ed9cac97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:39.415774 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ec0f6fdd-1a81-4e1b-8f2d-66b5ed9cac97 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1728 microversion: 2.1 time: 0.169965 Sep 09 23:25:39.431838 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 273/570] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:39 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:39.434364 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-97bbd6b4-d3c5-46e2-876f-652e0d168c23 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:39.434984 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-97bbd6b4-d3c5-46e2-876f-652e0d168c23 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:39.441066 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-acca62e0-3bcc-465a-b9d2-178b1aa6a759 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:39.441709 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-acca62e0-3bcc-465a-b9d2-178b1aa6a759 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:39.447564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-97bbd6b4-d3c5-46e2-876f-652e0d168c23 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:39.448062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-97bbd6b4-d3c5-46e2-876f-652e0d168c23 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:39.448497 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-97bbd6b4-d3c5-46e2-876f-652e0d168c23 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:39.448802 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-acca62e0-3bcc-465a-b9d2-178b1aa6a759 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:39.449194 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-97bbd6b4-d3c5-46e2-876f-652e0d168c23 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:39.449647 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-97bbd6b4-d3c5-46e2-876f-652e0d168c23 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:39.449867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-acca62e0-3bcc-465a-b9d2-178b1aa6a759 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:39.450413 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-97bbd6b4-d3c5-46e2-876f-652e0d168c23 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:39.450752 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-acca62e0-3bcc-465a-b9d2-178b1aa6a759 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:39.452209 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-acca62e0-3bcc-465a-b9d2-178b1aa6a759 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:39.452684 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-acca62e0-3bcc-465a-b9d2-178b1aa6a759 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:39.453102 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-acca62e0-3bcc-465a-b9d2-178b1aa6a759 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:39.544063 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-acca62e0-3bcc-465a-b9d2-178b1aa6a759 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107032 Sep 09 23:25:39.553886 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 274/571] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 23:25:39 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:25:39.713609 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-97bbd6b4-d3c5-46e2-876f-652e0d168c23 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:39.736758 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-97bbd6b4-d3c5-46e2-876f-652e0d168c23 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1314 microversion: 2.1 time: 0.320242 Sep 09 23:25:39.754080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 298/572] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:39 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:39.907855 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3d7a260c-dd80-4b87-8427-7cecebff494f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:39.908467 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3d7a260c-dd80-4b87-8427-7cecebff494f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:39.914641 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3d7a260c-dd80-4b87-8427-7cecebff494f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:39.915541 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3d7a260c-dd80-4b87-8427-7cecebff494f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:39.916296 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3d7a260c-dd80-4b87-8427-7cecebff494f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:39.917237 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3d7a260c-dd80-4b87-8427-7cecebff494f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:39.917927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3d7a260c-dd80-4b87-8427-7cecebff494f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:39.918439 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3d7a260c-dd80-4b87-8427-7cecebff494f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:40.269866 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3d7a260c-dd80-4b87-8427-7cecebff494f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:40.281522 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3d7a260c-dd80-4b87-8427-7cecebff494f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:40.283465 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3d7a260c-dd80-4b87-8427-7cecebff494f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:40.284830 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3d7a260c-dd80-4b87-8427-7cecebff494f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.381192 Sep 09 23:25:40.285982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 275/573] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:39 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:40.762655 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1532e5d7-8ade-4873-a50f-62028b5307ce tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:40.763266 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1532e5d7-8ade-4873-a50f-62028b5307ce tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:40.780898 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1532e5d7-8ade-4873-a50f-62028b5307ce tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:40.781386 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1532e5d7-8ade-4873-a50f-62028b5307ce tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:40.781816 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1532e5d7-8ade-4873-a50f-62028b5307ce tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:40.782549 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1532e5d7-8ade-4873-a50f-62028b5307ce tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:40.782999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1532e5d7-8ade-4873-a50f-62028b5307ce tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:40.783422 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1532e5d7-8ade-4873-a50f-62028b5307ce tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:40.995314 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-58f97cc2-2f82-4e44-ad5d-b4d44566dba8 req-86330680-2bcd-4987-84ef-82011b770152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff", "tag": "4ed06e43-5924-4dd9-b9a7-e0cbcd55d744"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:25:41.005505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-58f97cc2-2f82-4e44-ad5d-b4d44566dba8 req-86330680-2bcd-4987-84ef-82011b770152 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:41.006281 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-58f97cc2-2f82-4e44-ad5d-b4d44566dba8 req-86330680-2bcd-4987-84ef-82011b770152 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:41.006897 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-58f97cc2-2f82-4e44-ad5d-b4d44566dba8 req-86330680-2bcd-4987-84ef-82011b770152 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:41.021864 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-58f97cc2-2f82-4e44-ad5d-b4d44566dba8 req-86330680-2bcd-4987-84ef-82011b770152 service nova] Creating event network-changed:4ed06e43-5924-4dd9-b9a7-e0cbcd55d744 for instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff on hv-cinder-85032 Sep 09 23:25:41.028052 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-58f97cc2-2f82-4e44-ad5d-b4d44566dba8 req-86330680-2bcd-4987-84ef-82011b770152 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037492 Sep 09 23:25:41.029275 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 276/574] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:25:41.065292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1532e5d7-8ade-4873-a50f-62028b5307ce tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:41.077941 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1532e5d7-8ade-4873-a50f-62028b5307ce tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1463 microversion: 2.1 time: 0.316664 Sep 09 23:25:41.090377 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 299/575] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:40 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1463 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:41.134143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-98f4bc6f-7969-474b-a758-459196d7fed3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:41.134838 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-98f4bc6f-7969-474b-a758-459196d7fed3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:41.141943 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-98f4bc6f-7969-474b-a758-459196d7fed3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:41.142469 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-98f4bc6f-7969-474b-a758-459196d7fed3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:41.142915 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-98f4bc6f-7969-474b-a758-459196d7fed3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:41.143625 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-98f4bc6f-7969-474b-a758-459196d7fed3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:41.144267 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-98f4bc6f-7969-474b-a758-459196d7fed3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:41.144706 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-98f4bc6f-7969-474b-a758-459196d7fed3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:41.171812 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-98f4bc6f-7969-474b-a758-459196d7fed3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Going to try to terminate instance {{(pid=121058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:25:41.312376 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-cde135f6-87e5-4697-b591-a8fbc1c4b9d7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:41.312376 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-cde135f6-87e5-4697-b591-a8fbc1c4b9d7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:41.319829 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:25:41.322969 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cde135f6-87e5-4697-b591-a8fbc1c4b9d7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:41.324843 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cde135f6-87e5-4697-b591-a8fbc1c4b9d7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:41.325443 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cde135f6-87e5-4697-b591-a8fbc1c4b9d7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:41.326584 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cde135f6-87e5-4697-b591-a8fbc1c4b9d7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:41.327215 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cde135f6-87e5-4697-b591-a8fbc1c4b9d7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:41.327821 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cde135f6-87e5-4697-b591-a8fbc1c4b9d7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:41.350429 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:25:41.494860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-98f4bc6f-7969-474b-a758-459196d7fed3 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "DELETE /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 204 len: 0 microversion: 2.1 time: 0.364784 Sep 09 23:25:41.495606 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 277/576] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:25:41 2022] DELETE /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:25:41.506602 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-84341cbd-3ae9-4e5d-a140-c735979a0a21 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:41.507546 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-84341cbd-3ae9-4e5d-a140-c735979a0a21 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:41.522284 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-84341cbd-3ae9-4e5d-a140-c735979a0a21 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:41.523654 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-84341cbd-3ae9-4e5d-a140-c735979a0a21 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:41.526160 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-84341cbd-3ae9-4e5d-a140-c735979a0a21 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:41.526160 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-84341cbd-3ae9-4e5d-a140-c735979a0a21 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:41.526160 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-84341cbd-3ae9-4e5d-a140-c735979a0a21 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:41.527980 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-84341cbd-3ae9-4e5d-a140-c735979a0a21 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:41.746336 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cde135f6-87e5-4697-b591-a8fbc1c4b9d7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:41.780073 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cde135f6-87e5-4697-b591-a8fbc1c4b9d7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:41.784307 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cde135f6-87e5-4697-b591-a8fbc1c4b9d7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:41.793756 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-cde135f6-87e5-4697-b591-a8fbc1c4b9d7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.486750 Sep 09 23:25:41.795303 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 300/577] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:41 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:25:41.812327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-84341cbd-3ae9-4e5d-a140-c735979a0a21 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:41.822787 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-84341cbd-3ae9-4e5d-a140-c735979a0a21 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1469 microversion: 2.1 time: 0.321247 Sep 09 23:25:41.837202 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 278/578] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:41 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1469 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:25:42.830670 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5aec5ba5-a028-4827-b979-8083745c5aa2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:42.831320 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5aec5ba5-a028-4827-b979-8083745c5aa2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:42.839110 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5aec5ba5-a028-4827-b979-8083745c5aa2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:42.843801 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5aec5ba5-a028-4827-b979-8083745c5aa2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:42.843801 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5aec5ba5-a028-4827-b979-8083745c5aa2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:42.845178 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5aec5ba5-a028-4827-b979-8083745c5aa2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:42.845647 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5aec5ba5-a028-4827-b979-8083745c5aa2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:42.846083 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5aec5ba5-a028-4827-b979-8083745c5aa2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:42.861829 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0ee91ba1-2341-45ee-8933-2b034b5b5878 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:42.863956 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0ee91ba1-2341-45ee-8933-2b034b5b5878 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:42.878296 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0ee91ba1-2341-45ee-8933-2b034b5b5878 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:42.879173 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0ee91ba1-2341-45ee-8933-2b034b5b5878 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:42.879910 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0ee91ba1-2341-45ee-8933-2b034b5b5878 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:42.880994 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0ee91ba1-2341-45ee-8933-2b034b5b5878 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:42.881676 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0ee91ba1-2341-45ee-8933-2b034b5b5878 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:42.882323 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0ee91ba1-2341-45ee-8933-2b034b5b5878 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:43.071691 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5aec5ba5-a028-4827-b979-8083745c5aa2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:43.082987 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5aec5ba5-a028-4827-b979-8083745c5aa2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:43.084591 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5aec5ba5-a028-4827-b979-8083745c5aa2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:43.085769 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5aec5ba5-a028-4827-b979-8083745c5aa2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.259165 Sep 09 23:25:43.086322 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 301/579] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:42 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:25:43.091291 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-58b79ae3-9071-4d22-ae9d-1f97343556ba req-d7a5f5b0-ec10-43e2-b257-377718f96cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff", "tag": "4ed06e43-5924-4dd9-b9a7-e0cbcd55d744"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:25:43.100337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-58b79ae3-9071-4d22-ae9d-1f97343556ba req-d7a5f5b0-ec10-43e2-b257-377718f96cfc service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:43.101065 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-58b79ae3-9071-4d22-ae9d-1f97343556ba req-d7a5f5b0-ec10-43e2-b257-377718f96cfc service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:43.101500 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-58b79ae3-9071-4d22-ae9d-1f97343556ba req-d7a5f5b0-ec10-43e2-b257-377718f96cfc service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:43.121117 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-58b79ae3-9071-4d22-ae9d-1f97343556ba req-d7a5f5b0-ec10-43e2-b257-377718f96cfc service nova] Creating event network-changed:4ed06e43-5924-4dd9-b9a7-e0cbcd55d744 for instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff on hv-cinder-85032 Sep 09 23:25:43.127147 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-58b79ae3-9071-4d22-ae9d-1f97343556ba req-d7a5f5b0-ec10-43e2-b257-377718f96cfc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039625 Sep 09 23:25:43.128056 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 302/580] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:25:43.163790 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0ee91ba1-2341-45ee-8933-2b034b5b5878 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:43.183697 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0ee91ba1-2341-45ee-8933-2b034b5b5878 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1469 microversion: 2.1 time: 0.338100 Sep 09 23:25:43.184935 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 279/581] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:42 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1469 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:44.114672 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-19a745bc-d717-4269-9e33-7f96134afc59 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:44.116012 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-19a745bc-d717-4269-9e33-7f96134afc59 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:44.129045 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-19a745bc-d717-4269-9e33-7f96134afc59 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:44.129568 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-19a745bc-d717-4269-9e33-7f96134afc59 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:44.130808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-19a745bc-d717-4269-9e33-7f96134afc59 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:44.133639 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-19a745bc-d717-4269-9e33-7f96134afc59 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:44.134163 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-19a745bc-d717-4269-9e33-7f96134afc59 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:44.135435 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-19a745bc-d717-4269-9e33-7f96134afc59 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:44.208266 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-26d9ef94-7daf-41df-b1c4-cef3c704e578 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:44.208893 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-26d9ef94-7daf-41df-b1c4-cef3c704e578 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:44.217183 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-26d9ef94-7daf-41df-b1c4-cef3c704e578 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:44.217912 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-26d9ef94-7daf-41df-b1c4-cef3c704e578 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:44.218709 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-26d9ef94-7daf-41df-b1c4-cef3c704e578 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:44.219602 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-26d9ef94-7daf-41df-b1c4-cef3c704e578 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:44.220274 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-26d9ef94-7daf-41df-b1c4-cef3c704e578 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:44.220882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-26d9ef94-7daf-41df-b1c4-cef3c704e578 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:44.300927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-26d9ef94-7daf-41df-b1c4-cef3c704e578 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4398271cfc094e81b7a120bdeeb6dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4694a14825f4600a0336e150452a9cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:44.311017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-26d9ef94-7daf-41df-b1c4-cef3c704e578 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 200 len: 1427 microversion: 2.1 time: 0.106236 Sep 09 23:25:44.329642 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 280/582] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:44 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:25:44.418326 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-19a745bc-d717-4269-9e33-7f96134afc59 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:44.431251 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-19a745bc-d717-4269-9e33-7f96134afc59 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:44.434136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-19a745bc-d717-4269-9e33-7f96134afc59 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:44.439928 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-19a745bc-d717-4269-9e33-7f96134afc59 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1802 microversion: 2.20 time: 0.330385 Sep 09 23:25:44.442975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 303/583] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:44 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1802 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:25:45.143144 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-ccfe25f6-ca6d-4b8f-90b8-df8800b2f20b req-44ecd2ce-8eba-41ef-b1ec-d78a337132ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b99c3b-e692-4386-bbdf-e3dbc1a304b1", "name": "network-vif-deleted", "tag": "5607c7a4-9f27-4940-9fd7-0f2ffa9cf82b"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:25:45.157018 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-ccfe25f6-ca6d-4b8f-90b8-df8800b2f20b req-44ecd2ce-8eba-41ef-b1ec-d78a337132ef service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:45.157837 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-ccfe25f6-ca6d-4b8f-90b8-df8800b2f20b req-44ecd2ce-8eba-41ef-b1ec-d78a337132ef service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:45.158389 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-ccfe25f6-ca6d-4b8f-90b8-df8800b2f20b req-44ecd2ce-8eba-41ef-b1ec-d78a337132ef service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:45.169816 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-ccfe25f6-ca6d-4b8f-90b8-df8800b2f20b req-44ecd2ce-8eba-41ef-b1ec-d78a337132ef service nova] Creating event network-vif-deleted:5607c7a4-9f27-4940-9fd7-0f2ffa9cf82b for instance 28b99c3b-e692-4386-bbdf-e3dbc1a304b1 on hv-cinder-85032 Sep 09 23:25:45.175667 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-ccfe25f6-ca6d-4b8f-90b8-df8800b2f20b req-44ecd2ce-8eba-41ef-b1ec-d78a337132ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036504 Sep 09 23:25:45.176169 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 281/584] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:25:45.340865 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c80019dc-0480-4a84-a603-ce4e395fd263 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:45.341737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-c80019dc-0480-4a84-a603-ce4e395fd263 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] [instance: 28b99c3b-e692-4386-bbdf-e3dbc1a304b1] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:45.351665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c80019dc-0480-4a84-a603-ce4e395fd263 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:45.352267 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c80019dc-0480-4a84-a603-ce4e395fd263 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:45.352841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c80019dc-0480-4a84-a603-ce4e395fd263 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:45.354025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c80019dc-0480-4a84-a603-ce4e395fd263 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:45.355571 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c80019dc-0480-4a84-a603-ce4e395fd263 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:45.356097 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c80019dc-0480-4a84-a603-ce4e395fd263 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:45.375657 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-c80019dc-0480-4a84-a603-ce4e395fd263 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] HTTP exception thrown: Instance 28b99c3b-e692-4386-bbdf-e3dbc1a304b1 could not be found. Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c80019dc-0480-4a84-a603-ce4e395fd263 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Request method failure captured: Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 HTTP/1.1 Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8tP5E2BSsGxyEH3Es4IPwPjl-H6KRwsEhVxydXsYahYpbetFe9BVOijjnC9WN-yEFbb8CLqc-1z9ML8VObZxcEYtntN-Hh9kgrW3rjVdibaNNW-k9AkDK36ghABU3DxK_YfVMbi5SI21X3MYr432UtK0kM2rnrTOHQRtB7A0wxhsr8 Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: d4694a14825f4600a0336e150452a9cf Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-VolumesNegativeTest-134849416 Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:25:45.377502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:25:45.379080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4694a14825f4600a0336e150452a9cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4694a14825f4600a0336e150452a9cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4694a14825f4600a0336e150452a9cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4694a14825f4600a0336e150452a9cf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:25:45.379080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-VolumesNegativeTest-134849416 Sep 09 23:25:45.379080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: d4694a14825f4600a0336e150452a9cf Sep 09 23:25:45.379080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-VolumesNegativeTest-134849416 Sep 09 23:25:45.379080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-VolumesNegativeTest-134849416-project Sep 09 23:25:45.379080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:25:45.379080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:25:45.379080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 4398271cfc094e81b7a120bdeeb6dafe Sep 09 23:25:45.379080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-VolumesNegativeTest-134849416-project Sep 09 23:25:45.379080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:25:45.379080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 28b99c3b-e692-4386-bbdf-e3dbc1a304b1 could not be found. Sep 09 23:25:45.379080 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '28b99c3b-e692-4386-bbdf-e3dbc1a304b1'} Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28b99c3b-e692-4386-bbdf-e3dbc1a304b1 could not be found. Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:25:45.379980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28b99c3b-e692-4386-bbdf-e3dbc1a304b1 could not be found. Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28b99c3b-e692-4386-bbdf-e3dbc1a304b1 could not be found. Sep 09 23:25:45.381676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:25:45.383037 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c80019dc-0480-4a84-a603-ce4e395fd263 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] Returning 404 to user: Instance 28b99c3b-e692-4386-bbdf-e3dbc1a304b1 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:25:45.383037 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-c80019dc-0480-4a84-a603-ce4e395fd263 tempest-VolumesNegativeTest-134849416 tempest-VolumesNegativeTest-134849416-project] 10.222.0.20 "GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1" status: 404 len: 111 microversion: 2.1 time: 0.044657 Sep 09 23:25:45.384198 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 304/585] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:25:45 2022] GET /compute/v2.1/servers/28b99c3b-e692-4386-bbdf-e3dbc1a304b1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:25:45.472329 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-917215e6-a41a-4b7d-80cb-af0cf577ec67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:25:45.473089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-917215e6-a41a-4b7d-80cb-af0cf577ec67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:25:45.479917 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-917215e6-a41a-4b7d-80cb-af0cf577ec67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:45.480418 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-917215e6-a41a-4b7d-80cb-af0cf577ec67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:45.480860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-917215e6-a41a-4b7d-80cb-af0cf577ec67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:45.481574 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-917215e6-a41a-4b7d-80cb-af0cf577ec67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:25:45.482218 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-917215e6-a41a-4b7d-80cb-af0cf577ec67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:25:45.482709 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-917215e6-a41a-4b7d-80cb-af0cf577ec67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:25:45.640593 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-917215e6-a41a-4b7d-80cb-af0cf577ec67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:45.650863 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-917215e6-a41a-4b7d-80cb-af0cf577ec67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:45.653175 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-917215e6-a41a-4b7d-80cb-af0cf577ec67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:25:45.655640 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-917215e6-a41a-4b7d-80cb-af0cf577ec67 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1789 microversion: 2.20 time: 0.189409 Sep 09 23:25:45.656622 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 282/586] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:25:45 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1789 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:01.758527 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-55e8c6d5-de9b-4536-9f69-cc6139937d37 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Action: 'create', calling method: .version_select at 0x7f908dcfd160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1311011562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDs3JB90SKuxQXDoN4GYnHhQSFqNwP50tpsyfp31+UV5lvlzq5TNQ2NPTb2G4fmzT7bzxvjD+uISHhgJ1qdKIT+gr/DxdS89V0g7EbAvMyLV5B88vXM0Qgsre59KLh0Ovw=="}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:01.765179 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=95 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:01.765917 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=18 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:01.778216 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-55e8c6d5-de9b-4536-9f69-cc6139937d37 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Getting quotas for project 28d0bb1d968841c2986b5eb164af953b. Resources: {'key_pairs'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:26:01.784077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-55e8c6d5-de9b-4536-9f69-cc6139937d37 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Getting quotas for user c4129e5f14794a619acdaf5c56a02cb8 and project 28d0bb1d968841c2986b5eb164af953b. Resources: {'key_pairs'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:26:01.796996 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR oslo.messaging._drivers.impl_rabbit [None req-55e8c6d5-de9b-4536-9f69-cc6139937d37 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [790b24eb-8481-4c8f-9e6c-72adecf7b8b5] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 23:26:02.806582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO oslo.messaging._drivers.impl_rabbit [None req-55e8c6d5-de9b-4536-9f69-cc6139937d37 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [790b24eb-8481-4c8f-9e6c-72adecf7b8b5] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42432. Sep 09 23:26:02.900452 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-55e8c6d5-de9b-4536-9f69-cc6139937d37 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.146053 Sep 09 23:26:02.901308 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 305/587] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 23:26:01 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:03.022855 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-443076773", "imageRef": "1f62b7d6-5bba-4047-9412-383f997cc1f7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1311011562", "networks": [{"uuid": "95206e5b-32cd-462d-94b3-5bc031cb4aa0"}]}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:03.032430 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:03.033181 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=26 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:03.080352 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.network.neutron [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] validate_networks() for [('95206e5b-32cd-462d-94b3-5bc031cb4aa0', None, None, None, None, None)] {{(pid=121058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:26:03.516228 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Flavor limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:26:03.516802 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Image limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:26:03.518040 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Flavor pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:26:03.518734 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Image pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:26:03.519561 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:26:03.530404 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:03.531586 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:03.532145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:03.532972 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:03.533655 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:03.534180 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:03.552950 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Getting quotas for project 28d0bb1d968841c2986b5eb164af953b. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:26:03.557290 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Getting quotas for user c4129e5f14794a619acdaf5c56a02cb8 and project 28d0bb1d968841c2986b5eb164af953b. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:26:03.569297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Going to run 1 instances... {{(pid=121058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:26:03.571635 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1f62b7d6-5bba-4047-9412-383f997cc1f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:26:03.694908 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-61de75c7-5cae-4dda-b2b4-443031dc6caa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676170 Sep 09 23:26:03.696613 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 283/588] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:26:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:26:03.707437 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5264f243-e037-4178-a6a8-be9aa590aae6 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:03.708367 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5264f243-e037-4178-a6a8-be9aa590aae6 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:03.792987 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5264f243-e037-4178-a6a8-be9aa590aae6 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:03.808043 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5264f243-e037-4178-a6a8-be9aa590aae6 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1258 microversion: 2.1 time: 0.104450 Sep 09 23:26:03.809139 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 306/589] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:03 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1258 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:04.833222 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4a657640-ff4b-4b4f-9441-8e945bedf87d tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:04.833848 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4a657640-ff4b-4b4f-9441-8e945bedf87d tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:04.902865 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4a657640-ff4b-4b4f-9441-8e945bedf87d tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:04.912029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4a657640-ff4b-4b4f-9441-8e945bedf87d tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1258 microversion: 2.1 time: 0.083130 Sep 09 23:26:04.925093 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 284/590] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:04 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1258 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:05.939118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3fa4e971-696c-44a5-8e23-6bc6b3eb41cc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:05.940336 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3fa4e971-696c-44a5-8e23-6bc6b3eb41cc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:05.956863 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3fa4e971-696c-44a5-8e23-6bc6b3eb41cc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:05.957426 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3fa4e971-696c-44a5-8e23-6bc6b3eb41cc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:05.958403 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3fa4e971-696c-44a5-8e23-6bc6b3eb41cc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:05.959119 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3fa4e971-696c-44a5-8e23-6bc6b3eb41cc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:05.959652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3fa4e971-696c-44a5-8e23-6bc6b3eb41cc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:05.960084 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3fa4e971-696c-44a5-8e23-6bc6b3eb41cc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:06.066936 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3fa4e971-696c-44a5-8e23-6bc6b3eb41cc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:06.073566 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3fa4e971-696c-44a5-8e23-6bc6b3eb41cc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1310 microversion: 2.1 time: 0.141429 Sep 09 23:26:06.074553 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 307/591] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:05 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1310 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:07.099212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a6d4277b-fd78-4490-829a-83e5d11424f1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:07.099826 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a6d4277b-fd78-4490-829a-83e5d11424f1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:07.108746 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a6d4277b-fd78-4490-829a-83e5d11424f1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:07.109238 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a6d4277b-fd78-4490-829a-83e5d11424f1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:07.109828 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a6d4277b-fd78-4490-829a-83e5d11424f1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:07.110754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a6d4277b-fd78-4490-829a-83e5d11424f1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:07.111393 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a6d4277b-fd78-4490-829a-83e5d11424f1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:07.115745 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a6d4277b-fd78-4490-829a-83e5d11424f1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:07.192298 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a6d4277b-fd78-4490-829a-83e5d11424f1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:07.204692 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a6d4277b-fd78-4490-829a-83e5d11424f1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1316 microversion: 2.1 time: 0.110733 Sep 09 23:26:07.205299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 285/592] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:07 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1316 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:08.230650 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3a885449-56d6-4572-855f-e6e9ac3c2226 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:08.234880 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3a885449-56d6-4572-855f-e6e9ac3c2226 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:08.250275 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a885449-56d6-4572-855f-e6e9ac3c2226 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:08.251190 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a885449-56d6-4572-855f-e6e9ac3c2226 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:08.252862 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a885449-56d6-4572-855f-e6e9ac3c2226 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:08.254002 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a885449-56d6-4572-855f-e6e9ac3c2226 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:08.256315 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a885449-56d6-4572-855f-e6e9ac3c2226 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:08.257620 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a885449-56d6-4572-855f-e6e9ac3c2226 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:09.094040 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3a885449-56d6-4572-855f-e6e9ac3c2226 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:09.117618 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3a885449-56d6-4572-855f-e6e9ac3c2226 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.892278 Sep 09 23:26:09.118417 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 308/593] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:08 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:09.176593 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3b992784-dc80-4f91-9212-9090dc5f6fae tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Action: 'create', calling method: .version_select at 0x7f908dd3c940>, body: {"keypair": {"name": "tempest-TestShelveInstance-469023736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcGhTygxfLpktGjB+1WEQeIhSekk4eN+Nvwy9L7SXbsKflc0AeHGTQaTR2iSa78+VOpPqJbREFgNu6vVcAqb8WXnovF4njfT4Ux1AjnzuFFkqTQ3UesJKbl/+5j0XGV0g=="}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:09.224325 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-3b992784-dc80-4f91-9212-9090dc5f6fae tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Getting quotas for project 602875e689b7476697ce2e9bbc3bf7b5. Resources: {'key_pairs'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:26:09.232384 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-3b992784-dc80-4f91-9212-9090dc5f6fae tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Getting quotas for user cf9d4a796a8c450486832bb10c3d4ad0 and project 602875e689b7476697ce2e9bbc3bf7b5. Resources: {'key_pairs'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:26:09.317212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3b992784-dc80-4f91-9212-9090dc5f6fae tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.312759 Sep 09 23:26:09.318275 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 286/594] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 23:26:09 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:26:09.773800 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-066c29a6-c521-49ca-9da7-b6c13f3c998e req-3e5a02c2-6dfe-4763-8e20-4c01c7772fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072aebfe-bdb3-47e7-9b55-deddc8c248e9", "tag": "d8801e29-936f-4850-b8b8-729b8370c4bc"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:09.798054 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-066c29a6-c521-49ca-9da7-b6c13f3c998e req-3e5a02c2-6dfe-4763-8e20-4c01c7772fb2 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:09.803442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-066c29a6-c521-49ca-9da7-b6c13f3c998e req-3e5a02c2-6dfe-4763-8e20-4c01c7772fb2 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:09.804179 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-066c29a6-c521-49ca-9da7-b6c13f3c998e req-3e5a02c2-6dfe-4763-8e20-4c01c7772fb2 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:09.848291 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-066c29a6-c521-49ca-9da7-b6c13f3c998e req-3e5a02c2-6dfe-4763-8e20-4c01c7772fb2 service nova] Creating event network-changed:d8801e29-936f-4850-b8b8-729b8370c4bc for instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 on hv-cinder-85032 Sep 09 23:26:09.860774 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-066c29a6-c521-49ca-9da7-b6c13f3c998e req-3e5a02c2-6dfe-4763-8e20-4c01c7772fb2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092077 Sep 09 23:26:09.861316 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 309/595] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:10.141555 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-6e5f622c-7ae6-4c49-a184-08b9f2fd591c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:10.142169 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-6e5f622c-7ae6-4c49-a184-08b9f2fd591c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:10.155030 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6e5f622c-7ae6-4c49-a184-08b9f2fd591c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:10.157707 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6e5f622c-7ae6-4c49-a184-08b9f2fd591c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:10.158166 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6e5f622c-7ae6-4c49-a184-08b9f2fd591c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:10.163250 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6e5f622c-7ae6-4c49-a184-08b9f2fd591c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:10.163767 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6e5f622c-7ae6-4c49-a184-08b9f2fd591c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:10.164364 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6e5f622c-7ae6-4c49-a184-08b9f2fd591c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:10.431550 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-6e5f622c-7ae6-4c49-a184-08b9f2fd591c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:10.447031 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-6e5f622c-7ae6-4c49-a184-08b9f2fd591c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.309886 Sep 09 23:26:10.454680 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 287/596] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:10 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:11.470992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c680874d-4cba-4396-b4e5-f3349a6f785e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:11.471697 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-c680874d-4cba-4396-b4e5-f3349a6f785e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:11.478629 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c680874d-4cba-4396-b4e5-f3349a6f785e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:11.479214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c680874d-4cba-4396-b4e5-f3349a6f785e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:11.479728 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c680874d-4cba-4396-b4e5-f3349a6f785e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:11.480522 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c680874d-4cba-4396-b4e5-f3349a6f785e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:11.481050 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c680874d-4cba-4396-b4e5-f3349a6f785e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:11.482202 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c680874d-4cba-4396-b4e5-f3349a6f785e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:11.700359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-c680874d-4cba-4396-b4e5-f3349a6f785e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:11.711421 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-c680874d-4cba-4396-b4e5-f3349a6f785e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.245853 Sep 09 23:26:11.722435 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 310/597] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:11 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:12.740708 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c6b975d3-4a28-4952-a93a-1d19044d12f4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:12.741400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c6b975d3-4a28-4952-a93a-1d19044d12f4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:12.748129 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c6b975d3-4a28-4952-a93a-1d19044d12f4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:12.748620 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c6b975d3-4a28-4952-a93a-1d19044d12f4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:12.749056 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c6b975d3-4a28-4952-a93a-1d19044d12f4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:12.749969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c6b975d3-4a28-4952-a93a-1d19044d12f4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:12.750351 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c6b975d3-4a28-4952-a93a-1d19044d12f4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:12.750783 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c6b975d3-4a28-4952-a93a-1d19044d12f4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:13.064635 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c6b975d3-4a28-4952-a93a-1d19044d12f4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:13.078298 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c6b975d3-4a28-4952-a93a-1d19044d12f4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.341255 Sep 09 23:26:13.079383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 288/598] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:12 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:14.115985 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-cbf7255e-93f7-4ffc-b580-3d6144d3cd3a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:14.116536 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-cbf7255e-93f7-4ffc-b580-3d6144d3cd3a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:14.119018 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=6 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:14.124222 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cbf7255e-93f7-4ffc-b580-3d6144d3cd3a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:14.124700 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cbf7255e-93f7-4ffc-b580-3d6144d3cd3a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:14.125135 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cbf7255e-93f7-4ffc-b580-3d6144d3cd3a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:14.125920 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cbf7255e-93f7-4ffc-b580-3d6144d3cd3a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:14.126410 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cbf7255e-93f7-4ffc-b580-3d6144d3cd3a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:14.126838 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cbf7255e-93f7-4ffc-b580-3d6144d3cd3a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:14.272528 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cbf7255e-93f7-4ffc-b580-3d6144d3cd3a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:14.280694 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-cbf7255e-93f7-4ffc-b580-3d6144d3cd3a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.168594 Sep 09 23:26:14.281412 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 311/599] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:14 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:14.344738 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=2 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:14.349796 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e3f2623e-dbb5-4fcc-92ca-92d0da8b9377 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:14.352863 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e3f2623e-dbb5-4fcc-92ca-92d0da8b9377 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:14.381649 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e3f2623e-dbb5-4fcc-92ca-92d0da8b9377 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:14.381649 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e3f2623e-dbb5-4fcc-92ca-92d0da8b9377 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:14.381649 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e3f2623e-dbb5-4fcc-92ca-92d0da8b9377 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:14.381649 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e3f2623e-dbb5-4fcc-92ca-92d0da8b9377 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:14.381935 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e3f2623e-dbb5-4fcc-92ca-92d0da8b9377 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:14.381935 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e3f2623e-dbb5-4fcc-92ca-92d0da8b9377 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:14.416812 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e3f2623e-dbb5-4fcc-92ca-92d0da8b9377 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072664 Sep 09 23:26:14.426510 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 289/600] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:26:14 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:26:14.490229 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-34a34457-a4ec-46a6-821d-128f8d824975 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:14.490918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-34a34457-a4ec-46a6-821d-128f8d824975 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:14.499801 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-34a34457-a4ec-46a6-821d-128f8d824975 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:14.500426 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-34a34457-a4ec-46a6-821d-128f8d824975 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:14.501162 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-34a34457-a4ec-46a6-821d-128f8d824975 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:14.502055 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-34a34457-a4ec-46a6-821d-128f8d824975 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:14.502793 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-34a34457-a4ec-46a6-821d-128f8d824975 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:14.503413 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-34a34457-a4ec-46a6-821d-128f8d824975 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:14.563530 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-34a34457-a4ec-46a6-821d-128f8d824975 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Going to try to terminate instance {{(pid=121059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:26:15.307175 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-fd74b7ee-f53e-4dd3-86cb-91b582f6185f tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:15.308177 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-fd74b7ee-f53e-4dd3-86cb-91b582f6185f tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:15.314646 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd74b7ee-f53e-4dd3-86cb-91b582f6185f tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:15.315153 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd74b7ee-f53e-4dd3-86cb-91b582f6185f tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:15.315599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd74b7ee-f53e-4dd3-86cb-91b582f6185f tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:15.316434 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd74b7ee-f53e-4dd3-86cb-91b582f6185f tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:15.316771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd74b7ee-f53e-4dd3-86cb-91b582f6185f tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:15.317202 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd74b7ee-f53e-4dd3-86cb-91b582f6185f tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:15.497878 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-fd74b7ee-f53e-4dd3-86cb-91b582f6185f tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:15.499497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-fd74b7ee-f53e-4dd3-86cb-91b582f6185f tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.194116 Sep 09 23:26:15.499875 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 290/601] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:15 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:15.732388 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-34a34457-a4ec-46a6-821d-128f8d824975 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 204 len: 0 microversion: 2.1 time: 1.245724 Sep 09 23:26:15.733288 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 312/602] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:26:14 2022] DELETE /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 0 bytes in 1247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:26:15.742221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-822b4b07-858b-4b8a-bc86-02b4cb73795f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:15.742956 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-822b4b07-858b-4b8a-bc86-02b4cb73795f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:15.754698 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-822b4b07-858b-4b8a-bc86-02b4cb73795f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:15.755186 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-822b4b07-858b-4b8a-bc86-02b4cb73795f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:15.755621 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-822b4b07-858b-4b8a-bc86-02b4cb73795f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:15.756317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-822b4b07-858b-4b8a-bc86-02b4cb73795f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:15.756770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-822b4b07-858b-4b8a-bc86-02b4cb73795f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:15.757193 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-822b4b07-858b-4b8a-bc86-02b4cb73795f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:15.909752 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-822b4b07-858b-4b8a-bc86-02b4cb73795f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:15.919483 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-822b4b07-858b-4b8a-bc86-02b4cb73795f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1674 microversion: 2.1 time: 0.181272 Sep 09 23:26:15.920544 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 291/603] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:15 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:16.525634 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-bba6cbdd-d763-4a00-96f8-a3bb409c7612 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:16.526215 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-bba6cbdd-d763-4a00-96f8-a3bb409c7612 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:16.535587 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bba6cbdd-d763-4a00-96f8-a3bb409c7612 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:16.536083 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bba6cbdd-d763-4a00-96f8-a3bb409c7612 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:16.536536 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bba6cbdd-d763-4a00-96f8-a3bb409c7612 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:16.537225 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bba6cbdd-d763-4a00-96f8-a3bb409c7612 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:16.543069 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bba6cbdd-d763-4a00-96f8-a3bb409c7612 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:16.543516 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bba6cbdd-d763-4a00-96f8-a3bb409c7612 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:16.714263 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-bba6cbdd-d763-4a00-96f8-a3bb409c7612 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:16.722622 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-bba6cbdd-d763-4a00-96f8-a3bb409c7612 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.203192 Sep 09 23:26:16.723181 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 313/604] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:16 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:16.945516 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-41f99b68-bea0-4b9b-be63-44a274747161 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:16.946155 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-41f99b68-bea0-4b9b-be63-44a274747161 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:16.953564 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41f99b68-bea0-4b9b-be63-44a274747161 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:16.954047 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41f99b68-bea0-4b9b-be63-44a274747161 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:16.954720 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41f99b68-bea0-4b9b-be63-44a274747161 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:16.955515 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41f99b68-bea0-4b9b-be63-44a274747161 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:16.956167 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41f99b68-bea0-4b9b-be63-44a274747161 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:16.956778 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41f99b68-bea0-4b9b-be63-44a274747161 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:17.114555 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-41f99b68-bea0-4b9b-be63-44a274747161 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:17.123289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-41f99b68-bea0-4b9b-be63-44a274747161 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1674 microversion: 2.1 time: 0.181783 Sep 09 23:26:17.123870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 292/605] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:16 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:17.746617 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a2d70ddf-40f2-4d44-a372-ce5482e1cf67 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:17.747924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a2d70ddf-40f2-4d44-a372-ce5482e1cf67 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:17.754799 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2d70ddf-40f2-4d44-a372-ce5482e1cf67 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:17.755294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2d70ddf-40f2-4d44-a372-ce5482e1cf67 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:17.755738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2d70ddf-40f2-4d44-a372-ce5482e1cf67 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:17.756484 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2d70ddf-40f2-4d44-a372-ce5482e1cf67 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:17.756945 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2d70ddf-40f2-4d44-a372-ce5482e1cf67 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:17.757374 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a2d70ddf-40f2-4d44-a372-ce5482e1cf67 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:17.895190 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a2d70ddf-40f2-4d44-a372-ce5482e1cf67 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:17.903104 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a2d70ddf-40f2-4d44-a372-ce5482e1cf67 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.160467 Sep 09 23:26:17.903881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 314/606] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:17 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:18.147643 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-15ed2d6d-b807-4b46-8bbd-58a627aef14c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:18.148254 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-15ed2d6d-b807-4b46-8bbd-58a627aef14c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:18.155540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-15ed2d6d-b807-4b46-8bbd-58a627aef14c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:18.156020 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-15ed2d6d-b807-4b46-8bbd-58a627aef14c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:18.156453 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-15ed2d6d-b807-4b46-8bbd-58a627aef14c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:18.157139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-15ed2d6d-b807-4b46-8bbd-58a627aef14c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:18.157632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-15ed2d6d-b807-4b46-8bbd-58a627aef14c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:18.158033 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-15ed2d6d-b807-4b46-8bbd-58a627aef14c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:18.295297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-15ed2d6d-b807-4b46-8bbd-58a627aef14c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:18.303008 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-15ed2d6d-b807-4b46-8bbd-58a627aef14c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1674 microversion: 2.1 time: 0.159285 Sep 09 23:26:18.303586 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 293/607] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:18 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:18.926323 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e598f307-2953-45be-8385-5ceffb10d945 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:18.926897 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e598f307-2953-45be-8385-5ceffb10d945 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:18.933277 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e598f307-2953-45be-8385-5ceffb10d945 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:18.933757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e598f307-2953-45be-8385-5ceffb10d945 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:18.934189 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e598f307-2953-45be-8385-5ceffb10d945 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:18.936131 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e598f307-2953-45be-8385-5ceffb10d945 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:18.936590 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e598f307-2953-45be-8385-5ceffb10d945 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:18.937017 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e598f307-2953-45be-8385-5ceffb10d945 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:19.074300 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e598f307-2953-45be-8385-5ceffb10d945 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:19.082297 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e598f307-2953-45be-8385-5ceffb10d945 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.159913 Sep 09 23:26:19.082892 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 315/608] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:18 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:19.124727 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7aff760b-bc25-4a46-8774-9855f70f94a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:19.125231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7aff760b-bc25-4a46-8774-9855f70f94a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:19.131488 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7aff760b-bc25-4a46-8774-9855f70f94a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:19.132038 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7aff760b-bc25-4a46-8774-9855f70f94a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:19.132485 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7aff760b-bc25-4a46-8774-9855f70f94a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:19.133184 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7aff760b-bc25-4a46-8774-9855f70f94a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:19.133647 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7aff760b-bc25-4a46-8774-9855f70f94a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:19.134078 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7aff760b-bc25-4a46-8774-9855f70f94a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:19.223567 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-7aff760b-bc25-4a46-8774-9855f70f94a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lazy-loading 'services' on Instance uuid 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:26:19.242302 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=12 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:19.328985 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c3ec1816-73ee-4be6-a2e9-f1d16688a21b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:19.329600 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-c3ec1816-73ee-4be6-a2e9-f1d16688a21b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:19.337373 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c3ec1816-73ee-4be6-a2e9-f1d16688a21b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:19.337857 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c3ec1816-73ee-4be6-a2e9-f1d16688a21b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:19.338301 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c3ec1816-73ee-4be6-a2e9-f1d16688a21b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:19.339013 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c3ec1816-73ee-4be6-a2e9-f1d16688a21b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:19.339465 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c3ec1816-73ee-4be6-a2e9-f1d16688a21b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:19.339884 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c3ec1816-73ee-4be6-a2e9-f1d16688a21b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:19.440659 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7aff760b-bc25-4a46-8774-9855f70f94a3 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-volume_attachments/2dee8f47-6a63-4ba4-870e-71db6f3e12e5" status: 202 len: 0 microversion: 2.1 time: 0.320418 Sep 09 23:26:19.441548 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 294/609] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 23:26:19 2022] DELETE /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-volume_attachments/2dee8f47-6a63-4ba4-870e-71db6f3e12e5 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:26:19.451175 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-aadf7ad9-0029-4b9c-ae08-8e92e1573111 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:19.453673 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-aadf7ad9-0029-4b9c-ae08-8e92e1573111 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:19.459797 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-aadf7ad9-0029-4b9c-ae08-8e92e1573111 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:19.460277 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-aadf7ad9-0029-4b9c-ae08-8e92e1573111 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:19.460709 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-aadf7ad9-0029-4b9c-ae08-8e92e1573111 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:19.461401 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-aadf7ad9-0029-4b9c-ae08-8e92e1573111 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:19.461851 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-aadf7ad9-0029-4b9c-ae08-8e92e1573111 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:19.462271 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-aadf7ad9-0029-4b9c-ae08-8e92e1573111 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:19.480172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-c3ec1816-73ee-4be6-a2e9-f1d16688a21b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:19.489577 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-c3ec1816-73ee-4be6-a2e9-f1d16688a21b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1674 microversion: 2.1 time: 0.166023 Sep 09 23:26:19.490155 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 316/610] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:19 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:19.494570 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-aadf7ad9-0029-4b9c-ae08-8e92e1573111 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048379 Sep 09 23:26:19.495211 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 295/611] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:26:19 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:26:20.104497 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fd23ac45-f73e-454d-bc5c-e217574e2672 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:20.105092 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-fd23ac45-f73e-454d-bc5c-e217574e2672 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:20.112606 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd23ac45-f73e-454d-bc5c-e217574e2672 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:20.113083 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd23ac45-f73e-454d-bc5c-e217574e2672 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:20.113510 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd23ac45-f73e-454d-bc5c-e217574e2672 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:20.114190 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd23ac45-f73e-454d-bc5c-e217574e2672 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:20.114669 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd23ac45-f73e-454d-bc5c-e217574e2672 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:20.115087 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fd23ac45-f73e-454d-bc5c-e217574e2672 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:20.255872 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fd23ac45-f73e-454d-bc5c-e217574e2672 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:20.265298 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-fd23ac45-f73e-454d-bc5c-e217574e2672 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.164536 Sep 09 23:26:20.270371 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 317/612] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:20 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:20.514564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-894abea6-d4d4-43a0-87e9-08d7746c2d0c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:20.515314 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-894abea6-d4d4-43a0-87e9-08d7746c2d0c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:20.521477 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-894abea6-d4d4-43a0-87e9-08d7746c2d0c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:20.522207 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-894abea6-d4d4-43a0-87e9-08d7746c2d0c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:20.522752 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-894abea6-d4d4-43a0-87e9-08d7746c2d0c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:20.523599 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-894abea6-d4d4-43a0-87e9-08d7746c2d0c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:20.524123 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-894abea6-d4d4-43a0-87e9-08d7746c2d0c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:20.524611 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-894abea6-d4d4-43a0-87e9-08d7746c2d0c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:20.618229 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a622fde2-b996-4b6c-9e95-fe0dccbc0d64 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:20.620553 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a622fde2-b996-4b6c-9e95-fe0dccbc0d64 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:20.627435 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a622fde2-b996-4b6c-9e95-fe0dccbc0d64 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:20.627914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a622fde2-b996-4b6c-9e95-fe0dccbc0d64 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:20.628346 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a622fde2-b996-4b6c-9e95-fe0dccbc0d64 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:20.629097 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a622fde2-b996-4b6c-9e95-fe0dccbc0d64 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:20.629572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a622fde2-b996-4b6c-9e95-fe0dccbc0d64 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:20.629980 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a622fde2-b996-4b6c-9e95-fe0dccbc0d64 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:20.660794 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a622fde2-b996-4b6c-9e95-fe0dccbc0d64 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157022 Sep 09 23:26:20.661367 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 296/613] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:26:20 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:26:20.662286 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-894abea6-d4d4-43a0-87e9-08d7746c2d0c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:20.673417 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-894abea6-d4d4-43a0-87e9-08d7746c2d0c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1674 microversion: 2.1 time: 0.164159 Sep 09 23:26:20.675308 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 318/614] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:20 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:21.288097 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4c902525-c120-4934-b978-6306eac212e4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:21.288850 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4c902525-c120-4934-b978-6306eac212e4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:21.296374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c902525-c120-4934-b978-6306eac212e4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:21.297173 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c902525-c120-4934-b978-6306eac212e4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:21.298060 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c902525-c120-4934-b978-6306eac212e4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:21.298900 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c902525-c120-4934-b978-6306eac212e4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:21.299633 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c902525-c120-4934-b978-6306eac212e4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:21.300294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c902525-c120-4934-b978-6306eac212e4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:21.528028 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4c902525-c120-4934-b978-6306eac212e4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:21.537512 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4c902525-c120-4934-b978-6306eac212e4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.253783 Sep 09 23:26:21.538171 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 297/615] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:21 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:21.674021 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-186bcc59-816d-44fb-9187-e45c9c5f4699 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:21.676267 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-186bcc59-816d-44fb-9187-e45c9c5f4699 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:21.682906 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-186bcc59-816d-44fb-9187-e45c9c5f4699 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:21.683408 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-186bcc59-816d-44fb-9187-e45c9c5f4699 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:21.683818 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-186bcc59-816d-44fb-9187-e45c9c5f4699 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:21.684501 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-186bcc59-816d-44fb-9187-e45c9c5f4699 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:21.686383 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-186bcc59-816d-44fb-9187-e45c9c5f4699 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:21.686816 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-186bcc59-816d-44fb-9187-e45c9c5f4699 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:21.698946 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-6dfdc12e-229c-45f3-af35-a1ea81ae219c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:21.702431 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-6dfdc12e-229c-45f3-af35-a1ea81ae219c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:21.708633 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6dfdc12e-229c-45f3-af35-a1ea81ae219c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:21.709201 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6dfdc12e-229c-45f3-af35-a1ea81ae219c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:21.709919 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6dfdc12e-229c-45f3-af35-a1ea81ae219c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:21.710729 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6dfdc12e-229c-45f3-af35-a1ea81ae219c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:21.711306 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6dfdc12e-229c-45f3-af35-a1ea81ae219c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:21.711804 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-6dfdc12e-229c-45f3-af35-a1ea81ae219c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:21.722051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-186bcc59-816d-44fb-9187-e45c9c5f4699 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052700 Sep 09 23:26:21.723078 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 319/616] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:26:21 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:21.955986 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-6dfdc12e-229c-45f3-af35-a1ea81ae219c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:21.965597 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-6dfdc12e-229c-45f3-af35-a1ea81ae219c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1674 microversion: 2.1 time: 0.270405 Sep 09 23:26:21.976999 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 298/617] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:21 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1674 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:22.561906 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ebd4fb9e-99ed-41f3-8ff3-330429666495 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:22.562637 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ebd4fb9e-99ed-41f3-8ff3-330429666495 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:22.569898 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ebd4fb9e-99ed-41f3-8ff3-330429666495 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:22.573980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ebd4fb9e-99ed-41f3-8ff3-330429666495 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:22.573980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ebd4fb9e-99ed-41f3-8ff3-330429666495 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:22.573980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ebd4fb9e-99ed-41f3-8ff3-330429666495 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:22.573980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ebd4fb9e-99ed-41f3-8ff3-330429666495 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:22.574499 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ebd4fb9e-99ed-41f3-8ff3-330429666495 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:22.680233 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-6c85a50b-9b7c-4091-8b33-31ed174667fe req-a8e7c41c-ec25-418b-9848-80e64adac617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56bd49b-8d5d-4de6-a394-2d097824a7c4", "name": "network-vif-deleted", "tag": "b86274a6-1ece-499f-902e-c213794d1b58"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:22.690635 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-6c85a50b-9b7c-4091-8b33-31ed174667fe req-a8e7c41c-ec25-418b-9848-80e64adac617 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:22.691417 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-6c85a50b-9b7c-4091-8b33-31ed174667fe req-a8e7c41c-ec25-418b-9848-80e64adac617 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:22.692281 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-6c85a50b-9b7c-4091-8b33-31ed174667fe req-a8e7c41c-ec25-418b-9848-80e64adac617 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:22.709141 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-6c85a50b-9b7c-4091-8b33-31ed174667fe req-a8e7c41c-ec25-418b-9848-80e64adac617 service nova] Creating event network-vif-deleted:b86274a6-1ece-499f-902e-c213794d1b58 for instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 on hv-cinder-85032 Sep 09 23:26:22.724577 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-6c85a50b-9b7c-4091-8b33-31ed174667fe req-a8e7c41c-ec25-418b-9848-80e64adac617 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047601 Sep 09 23:26:22.725548 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 299/618] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:26:22.736075 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-82f4c756-2b6b-46be-907b-f16f9122847e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:22.738787 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-82f4c756-2b6b-46be-907b-f16f9122847e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:22.746575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-82f4c756-2b6b-46be-907b-f16f9122847e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:22.747759 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-82f4c756-2b6b-46be-907b-f16f9122847e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:22.748737 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-82f4c756-2b6b-46be-907b-f16f9122847e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:22.749714 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-82f4c756-2b6b-46be-907b-f16f9122847e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:22.750245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-82f4c756-2b6b-46be-907b-f16f9122847e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:22.755824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-82f4c756-2b6b-46be-907b-f16f9122847e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:22.768779 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ebd4fb9e-99ed-41f3-8ff3-330429666495 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:22.777678 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ebd4fb9e-99ed-41f3-8ff3-330429666495 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.220508 Sep 09 23:26:22.796650 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 320/619] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:22 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:22.799885 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-82f4c756-2b6b-46be-907b-f16f9122847e tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069515 Sep 09 23:26:22.800983 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 300/620] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:26:22 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:26:22.900923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-703eb865-b632-4556-b6f4-ff39a97e1ac2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:22.901415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-703eb865-b632-4556-b6f4-ff39a97e1ac2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:22.910022 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-703eb865-b632-4556-b6f4-ff39a97e1ac2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:22.910957 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-703eb865-b632-4556-b6f4-ff39a97e1ac2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:22.911561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-703eb865-b632-4556-b6f4-ff39a97e1ac2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:22.912429 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-703eb865-b632-4556-b6f4-ff39a97e1ac2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:22.913095 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-703eb865-b632-4556-b6f4-ff39a97e1ac2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:22.913826 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-703eb865-b632-4556-b6f4-ff39a97e1ac2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:22.944110 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-703eb865-b632-4556-b6f4-ff39a97e1ac2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Going to try to terminate instance {{(pid=121059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:26:22.975012 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:22.990032 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8ab2246b-28f6-4fc8-91f8-c4642ec7d4a6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:22.990749 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8ab2246b-28f6-4fc8-91f8-c4642ec7d4a6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:22.996821 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ab2246b-28f6-4fc8-91f8-c4642ec7d4a6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:22.997956 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ab2246b-28f6-4fc8-91f8-c4642ec7d4a6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:22.998484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ab2246b-28f6-4fc8-91f8-c4642ec7d4a6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:22.999300 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ab2246b-28f6-4fc8-91f8-c4642ec7d4a6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:22.999843 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ab2246b-28f6-4fc8-91f8-c4642ec7d4a6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:23.000289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8ab2246b-28f6-4fc8-91f8-c4642ec7d4a6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:23.099970 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8ab2246b-28f6-4fc8-91f8-c4642ec7d4a6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:23.115685 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8ab2246b-28f6-4fc8-91f8-c4642ec7d4a6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1607 microversion: 2.1 time: 0.122892 Sep 09 23:26:23.115685 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 301/621] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:22 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1607 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:23.217987 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-703eb865-b632-4556-b6f4-ff39a97e1ac2 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 204 len: 0 microversion: 2.1 time: 0.320796 Sep 09 23:26:23.227049 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3beb8377-40ba-4345-961d-a674e2182b79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:23.227469 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 321/622] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:26:22 2022] DELETE /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:26:23.228327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3beb8377-40ba-4345-961d-a674e2182b79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:23.238080 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3beb8377-40ba-4345-961d-a674e2182b79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:23.238970 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3beb8377-40ba-4345-961d-a674e2182b79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:23.239682 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3beb8377-40ba-4345-961d-a674e2182b79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:23.240750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3beb8377-40ba-4345-961d-a674e2182b79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:23.241736 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3beb8377-40ba-4345-961d-a674e2182b79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:23.242724 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3beb8377-40ba-4345-961d-a674e2182b79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:23.260658 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:23.391899 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3beb8377-40ba-4345-961d-a674e2182b79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:23.401881 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3beb8377-40ba-4345-961d-a674e2182b79 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1688 microversion: 2.1 time: 0.178561 Sep 09 23:26:23.402652 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 302/623] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:23 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:23.803399 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-eb7ccf9b-ef4f-4b1a-a571-502fc9053f44 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:23.804096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-eb7ccf9b-ef4f-4b1a-a571-502fc9053f44 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:23.811989 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb7ccf9b-ef4f-4b1a-a571-502fc9053f44 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:23.812615 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb7ccf9b-ef4f-4b1a-a571-502fc9053f44 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:23.813181 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb7ccf9b-ef4f-4b1a-a571-502fc9053f44 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:23.813977 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb7ccf9b-ef4f-4b1a-a571-502fc9053f44 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:23.814590 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb7ccf9b-ef4f-4b1a-a571-502fc9053f44 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:23.815107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb7ccf9b-ef4f-4b1a-a571-502fc9053f44 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:23.973021 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-eb7ccf9b-ef4f-4b1a-a571-502fc9053f44 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:23.982735 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-eb7ccf9b-ef4f-4b1a-a571-502fc9053f44 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.183608 Sep 09 23:26:23.983830 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 322/624] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:23 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:24.139422 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-2f9eea0b-1f1b-4315-9809-b7d3c610d3aa tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:24.140025 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-2f9eea0b-1f1b-4315-9809-b7d3c610d3aa tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:24.147249 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2f9eea0b-1f1b-4315-9809-b7d3c610d3aa tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:24.147747 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2f9eea0b-1f1b-4315-9809-b7d3c610d3aa tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:24.148192 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2f9eea0b-1f1b-4315-9809-b7d3c610d3aa tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:24.148927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2f9eea0b-1f1b-4315-9809-b7d3c610d3aa tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:24.149545 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2f9eea0b-1f1b-4315-9809-b7d3c610d3aa tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:24.149984 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2f9eea0b-1f1b-4315-9809-b7d3c610d3aa tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:24.218217 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-2f9eea0b-1f1b-4315-9809-b7d3c610d3aa tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:24.226287 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-2f9eea0b-1f1b-4315-9809-b7d3c610d3aa tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1323 microversion: 2.1 time: 0.091657 Sep 09 23:26:24.226896 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 303/625] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:24 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1323 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:24.428554 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b4de2b9c-7a29-4730-be81-78c037bd7498 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:24.429241 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b4de2b9c-7a29-4730-be81-78c037bd7498 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:24.435634 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b4de2b9c-7a29-4730-be81-78c037bd7498 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:24.436200 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b4de2b9c-7a29-4730-be81-78c037bd7498 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:24.436709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b4de2b9c-7a29-4730-be81-78c037bd7498 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:24.437472 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b4de2b9c-7a29-4730-be81-78c037bd7498 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:24.437999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b4de2b9c-7a29-4730-be81-78c037bd7498 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:24.438526 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b4de2b9c-7a29-4730-be81-78c037bd7498 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:24.570026 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b4de2b9c-7a29-4730-be81-78c037bd7498 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:24.578991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b4de2b9c-7a29-4730-be81-78c037bd7498 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1688 microversion: 2.1 time: 0.157111 Sep 09 23:26:24.583598 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 323/626] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:24 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:24.780504 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-f0a766d3-d9ad-4764-9870-fd364ba3d32a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:24.781078 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-f0a766d3-d9ad-4764-9870-fd364ba3d32a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:24.789348 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0a766d3-d9ad-4764-9870-fd364ba3d32a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:24.789348 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0a766d3-d9ad-4764-9870-fd364ba3d32a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:24.789348 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0a766d3-d9ad-4764-9870-fd364ba3d32a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:24.789348 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0a766d3-d9ad-4764-9870-fd364ba3d32a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:24.789702 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0a766d3-d9ad-4764-9870-fd364ba3d32a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:24.789702 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0a766d3-d9ad-4764-9870-fd364ba3d32a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:24.820820 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-f0a766d3-d9ad-4764-9870-fd364ba3d32a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-volume_attachments/69903d8f-3493-4a24-b0d6-b69feb7320b5" status: 200 len: 194 microversion: 2.20 time: 0.044522 Sep 09 23:26:24.821408 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 304/627] 10.222.0.20 () {60 vars in 1454 bytes} [Fri Sep 9 23:26:24 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-volume_attachments/69903d8f-3493-4a24-b0d6-b69feb7320b5 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:26:24.896179 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a35e2555-652a-42eb-9e98-291e6e9350dd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:24.896675 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a35e2555-652a-42eb-9e98-291e6e9350dd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:24.903263 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a35e2555-652a-42eb-9e98-291e6e9350dd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:24.903785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a35e2555-652a-42eb-9e98-291e6e9350dd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:24.904227 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a35e2555-652a-42eb-9e98-291e6e9350dd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:24.904936 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a35e2555-652a-42eb-9e98-291e6e9350dd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:24.905391 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a35e2555-652a-42eb-9e98-291e6e9350dd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:24.905814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a35e2555-652a-42eb-9e98-291e6e9350dd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:24.991573 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-a35e2555-652a-42eb-9e98-291e6e9350dd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lazy-loading 'services' on Instance uuid 61a8b2e1-79be-4c0d-b316-94c95ae04638 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:26:25.006150 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-2b9fa519-6d2b-43a6-9b97-1465a2e6939a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:25.006916 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-2b9fa519-6d2b-43a6-9b97-1465a2e6939a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:25.013603 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2b9fa519-6d2b-43a6-9b97-1465a2e6939a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:25.014245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2b9fa519-6d2b-43a6-9b97-1465a2e6939a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:25.014865 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2b9fa519-6d2b-43a6-9b97-1465a2e6939a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:25.015722 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2b9fa519-6d2b-43a6-9b97-1465a2e6939a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:25.016298 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2b9fa519-6d2b-43a6-9b97-1465a2e6939a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:25.016926 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2b9fa519-6d2b-43a6-9b97-1465a2e6939a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:25.158726 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-2b9fa519-6d2b-43a6-9b97-1465a2e6939a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:25.166660 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-2b9fa519-6d2b-43a6-9b97-1465a2e6939a tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.164709 Sep 09 23:26:25.167243 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 305/628] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:25 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:25.249417 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e27c8f49-cee1-4f16-9d9c-0415564e9f93 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:25.250037 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e27c8f49-cee1-4f16-9d9c-0415564e9f93 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:25.255949 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e27c8f49-cee1-4f16-9d9c-0415564e9f93 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:25.256438 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e27c8f49-cee1-4f16-9d9c-0415564e9f93 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:25.256886 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e27c8f49-cee1-4f16-9d9c-0415564e9f93 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:25.257581 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e27c8f49-cee1-4f16-9d9c-0415564e9f93 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:25.258046 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e27c8f49-cee1-4f16-9d9c-0415564e9f93 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:25.258504 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e27c8f49-cee1-4f16-9d9c-0415564e9f93 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:25.261974 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a35e2555-652a-42eb-9e98-291e6e9350dd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-volume_attachments/69903d8f-3493-4a24-b0d6-b69feb7320b5" status: 202 len: 0 microversion: 2.20 time: 0.369537 Sep 09 23:26:25.262548 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 324/629] 10.222.0.20 () {60 vars in 1457 bytes} [Fri Sep 9 23:26:24 2022] DELETE /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-volume_attachments/69903d8f-3493-4a24-b0d6-b69feb7320b5 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:26:25.271215 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e50ca23e-7c84-49f2-acf5-80f57a1276f1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:25.273530 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e50ca23e-7c84-49f2-acf5-80f57a1276f1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:25.280285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e50ca23e-7c84-49f2-acf5-80f57a1276f1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:25.280769 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e50ca23e-7c84-49f2-acf5-80f57a1276f1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:25.281212 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e50ca23e-7c84-49f2-acf5-80f57a1276f1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:25.281901 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e50ca23e-7c84-49f2-acf5-80f57a1276f1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:25.282374 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e50ca23e-7c84-49f2-acf5-80f57a1276f1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:25.282809 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e50ca23e-7c84-49f2-acf5-80f57a1276f1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:25.313005 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e50ca23e-7c84-49f2-acf5-80f57a1276f1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045871 Sep 09 23:26:25.313566 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 325/630] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Sep 9 23:26:25 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 23:26:25.320197 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e27c8f49-cee1-4f16-9d9c-0415564e9f93 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:25.327957 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e27c8f49-cee1-4f16-9d9c-0415564e9f93 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1323 microversion: 2.1 time: 0.082522 Sep 09 23:26:25.328512 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 306/631] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:25 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1323 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:25.602380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-06b60cf5-0cc0-4cd9-90cc-a5732b722156 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:25.602999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-06b60cf5-0cc0-4cd9-90cc-a5732b722156 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:25.609342 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-06b60cf5-0cc0-4cd9-90cc-a5732b722156 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:25.609825 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-06b60cf5-0cc0-4cd9-90cc-a5732b722156 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:25.610264 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-06b60cf5-0cc0-4cd9-90cc-a5732b722156 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:25.610973 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-06b60cf5-0cc0-4cd9-90cc-a5732b722156 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:25.611432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-06b60cf5-0cc0-4cd9-90cc-a5732b722156 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:25.611858 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-06b60cf5-0cc0-4cd9-90cc-a5732b722156 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:25.740604 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-06b60cf5-0cc0-4cd9-90cc-a5732b722156 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:25.749124 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-06b60cf5-0cc0-4cd9-90cc-a5732b722156 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1688 microversion: 2.1 time: 0.150575 Sep 09 23:26:25.749687 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 326/632] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:25 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:26.190302 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e2eb53f7-73ca-44f6-ad39-a88a5e20c5d5 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:26.191070 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e2eb53f7-73ca-44f6-ad39-a88a5e20c5d5 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:26.197523 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e2eb53f7-73ca-44f6-ad39-a88a5e20c5d5 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:26.198087 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e2eb53f7-73ca-44f6-ad39-a88a5e20c5d5 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:26.198567 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e2eb53f7-73ca-44f6-ad39-a88a5e20c5d5 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:26.199262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e2eb53f7-73ca-44f6-ad39-a88a5e20c5d5 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:26.199723 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e2eb53f7-73ca-44f6-ad39-a88a5e20c5d5 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:26.200807 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e2eb53f7-73ca-44f6-ad39-a88a5e20c5d5 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:26.325683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d2a63ea5-2a33-442f-828a-0e0ef23170bc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:26.328449 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d2a63ea5-2a33-442f-828a-0e0ef23170bc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:26.329073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e2eb53f7-73ca-44f6-ad39-a88a5e20c5d5 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:26.335033 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2a63ea5-2a33-442f-828a-0e0ef23170bc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:26.335516 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2a63ea5-2a33-442f-828a-0e0ef23170bc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:26.335957 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2a63ea5-2a33-442f-828a-0e0ef23170bc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:26.336659 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2a63ea5-2a33-442f-828a-0e0ef23170bc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:26.337082 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e2eb53f7-73ca-44f6-ad39-a88a5e20c5d5 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.150497 Sep 09 23:26:26.337189 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2a63ea5-2a33-442f-828a-0e0ef23170bc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:26.337538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d2a63ea5-2a33-442f-828a-0e0ef23170bc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:26.337870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 307/633] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:26 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:26.350972 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-f056d793-6497-49d3-9721-79496104ffe8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:26.351728 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-f056d793-6497-49d3-9721-79496104ffe8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:26.359538 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f056d793-6497-49d3-9721-79496104ffe8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:26.360147 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f056d793-6497-49d3-9721-79496104ffe8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:26.360588 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f056d793-6497-49d3-9721-79496104ffe8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:26.361311 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f056d793-6497-49d3-9721-79496104ffe8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:26.361793 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f056d793-6497-49d3-9721-79496104ffe8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:26.362284 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f056d793-6497-49d3-9721-79496104ffe8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:26.369312 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d2a63ea5-2a33-442f-828a-0e0ef23170bc tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047680 Sep 09 23:26:26.370054 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 327/634] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Sep 9 23:26:26 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 23:26:26.429072 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-f056d793-6497-49d3-9721-79496104ffe8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:26.437515 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-f056d793-6497-49d3-9721-79496104ffe8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1323 microversion: 2.1 time: 0.090212 Sep 09 23:26:26.438089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 308/635] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:26 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1323 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:26.604663 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-a4e86d14-4a2f-4ebc-8fbd-a786e7940f40 req-d310237b-c245-4ddf-87f5-18bda3719687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072aebfe-bdb3-47e7-9b55-deddc8c248e9", "name": "network-vif-plugged", "status": "completed", "tag": "d8801e29-936f-4850-b8b8-729b8370c4bc"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:26.614979 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-a4e86d14-4a2f-4ebc-8fbd-a786e7940f40 req-d310237b-c245-4ddf-87f5-18bda3719687 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:26.615456 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-a4e86d14-4a2f-4ebc-8fbd-a786e7940f40 req-d310237b-c245-4ddf-87f5-18bda3719687 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:26.615889 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-a4e86d14-4a2f-4ebc-8fbd-a786e7940f40 req-d310237b-c245-4ddf-87f5-18bda3719687 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:26.627460 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-a4e86d14-4a2f-4ebc-8fbd-a786e7940f40 req-d310237b-c245-4ddf-87f5-18bda3719687 service nova] Creating event network-vif-plugged:d8801e29-936f-4850-b8b8-729b8370c4bc for instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 on hv-cinder-85032 Sep 09 23:26:26.632183 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-a4e86d14-4a2f-4ebc-8fbd-a786e7940f40 req-d310237b-c245-4ddf-87f5-18bda3719687 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031422 Sep 09 23:26:26.638870 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 328/636] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:26.774218 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-930f296c-e7f4-4f6b-8d45-3331b1c82926 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:26.774927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-930f296c-e7f4-4f6b-8d45-3331b1c82926 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:26.781963 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-930f296c-e7f4-4f6b-8d45-3331b1c82926 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:26.782524 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-930f296c-e7f4-4f6b-8d45-3331b1c82926 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:26.782966 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-930f296c-e7f4-4f6b-8d45-3331b1c82926 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:26.783667 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-930f296c-e7f4-4f6b-8d45-3331b1c82926 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:26.784126 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-930f296c-e7f4-4f6b-8d45-3331b1c82926 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:26.784588 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-930f296c-e7f4-4f6b-8d45-3331b1c82926 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:26.926893 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-930f296c-e7f4-4f6b-8d45-3331b1c82926 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:26.933349 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-930f296c-e7f4-4f6b-8d45-3331b1c82926 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1688 microversion: 2.1 time: 0.164168 Sep 09 23:26:26.934735 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 309/637] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:26 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:27.361201 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-752118da-87b0-4e76-89ed-e5d2aa36bca3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:27.361903 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-752118da-87b0-4e76-89ed-e5d2aa36bca3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:27.368118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-752118da-87b0-4e76-89ed-e5d2aa36bca3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:27.368601 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-752118da-87b0-4e76-89ed-e5d2aa36bca3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:27.369040 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-752118da-87b0-4e76-89ed-e5d2aa36bca3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:27.369730 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-752118da-87b0-4e76-89ed-e5d2aa36bca3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:27.370186 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-752118da-87b0-4e76-89ed-e5d2aa36bca3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:27.370640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-752118da-87b0-4e76-89ed-e5d2aa36bca3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:27.383210 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-215d5697-2449-4058-bc88-c45cf17832d2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:27.385407 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-215d5697-2449-4058-bc88-c45cf17832d2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:27.392403 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-215d5697-2449-4058-bc88-c45cf17832d2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:27.392886 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-215d5697-2449-4058-bc88-c45cf17832d2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:27.393325 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-215d5697-2449-4058-bc88-c45cf17832d2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:27.394022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-215d5697-2449-4058-bc88-c45cf17832d2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:27.394514 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-215d5697-2449-4058-bc88-c45cf17832d2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:27.394944 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-215d5697-2449-4058-bc88-c45cf17832d2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:27.427090 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-215d5697-2449-4058-bc88-c45cf17832d2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048229 Sep 09 23:26:27.427678 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 310/638] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Sep 9 23:26:27 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 23:26:27.460793 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a9a206e7-9f16-404c-82b7-ae4394a2575d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:27.461404 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a9a206e7-9f16-404c-82b7-ae4394a2575d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:27.468526 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9a206e7-9f16-404c-82b7-ae4394a2575d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:27.469007 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9a206e7-9f16-404c-82b7-ae4394a2575d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:27.469445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9a206e7-9f16-404c-82b7-ae4394a2575d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:27.470137 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9a206e7-9f16-404c-82b7-ae4394a2575d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:27.470619 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9a206e7-9f16-404c-82b7-ae4394a2575d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:27.471042 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9a206e7-9f16-404c-82b7-ae4394a2575d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:27.502997 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9a206e7-9f16-404c-82b7-ae4394a2575d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:27.503264 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-752118da-87b0-4e76-89ed-e5d2aa36bca3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:27.503492 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9a206e7-9f16-404c-82b7-ae4394a2575d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:27.503934 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9a206e7-9f16-404c-82b7-ae4394a2575d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:27.504383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-a9a206e7-9f16-404c-82b7-ae4394a2575d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lazy-loading 'fault' on Instance uuid e56bd49b-8d5d-4de6-a394-2d097824a7c4 {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:26:27.510874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-752118da-87b0-4e76-89ed-e5d2aa36bca3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.154318 Sep 09 23:26:27.511444 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 329/639] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:27 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:27.544692 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a9a206e7-9f16-404c-82b7-ae4394a2575d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:27.553913 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a9a206e7-9f16-404c-82b7-ae4394a2575d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1328 microversion: 2.1 time: 0.096801 Sep 09 23:26:27.554823 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 311/640] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:27 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1328 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:27.965864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e0c8af2a-faeb-41e4-ae86-88b998d57bf5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:27.966813 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e0c8af2a-faeb-41e4-ae86-88b998d57bf5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:27.974549 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e0c8af2a-faeb-41e4-ae86-88b998d57bf5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:27.975034 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e0c8af2a-faeb-41e4-ae86-88b998d57bf5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:27.975487 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e0c8af2a-faeb-41e4-ae86-88b998d57bf5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:27.976184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e0c8af2a-faeb-41e4-ae86-88b998d57bf5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:27.976727 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e0c8af2a-faeb-41e4-ae86-88b998d57bf5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:27.977154 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e0c8af2a-faeb-41e4-ae86-88b998d57bf5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:28.132796 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e0c8af2a-faeb-41e4-ae86-88b998d57bf5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:28.141307 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e0c8af2a-faeb-41e4-ae86-88b998d57bf5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1688 microversion: 2.1 time: 0.184296 Sep 09 23:26:28.141893 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 330/641] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:27 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:28.444136 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-01a8f8df-4e88-4527-820c-cf75b539c779 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:28.445419 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-01a8f8df-4e88-4527-820c-cf75b539c779 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:28.456810 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-8e05269b-a02f-492b-ad00-fa67cb9ff00c req-15c8afd5-9631-4c74-8a34-a2e1a9490ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff", "name": "network-vif-deleted", "tag": "4ed06e43-5924-4dd9-b9a7-e0cbcd55d744"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:28.465943 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01a8f8df-4e88-4527-820c-cf75b539c779 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:28.467296 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01a8f8df-4e88-4527-820c-cf75b539c779 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:28.468840 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01a8f8df-4e88-4527-820c-cf75b539c779 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:28.469063 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-8e05269b-a02f-492b-ad00-fa67cb9ff00c req-15c8afd5-9631-4c74-8a34-a2e1a9490ecd service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:28.472252 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-8e05269b-a02f-492b-ad00-fa67cb9ff00c req-15c8afd5-9631-4c74-8a34-a2e1a9490ecd service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:28.472252 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-8e05269b-a02f-492b-ad00-fa67cb9ff00c req-15c8afd5-9631-4c74-8a34-a2e1a9490ecd service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:28.472495 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01a8f8df-4e88-4527-820c-cf75b539c779 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:28.472495 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01a8f8df-4e88-4527-820c-cf75b539c779 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:28.472495 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01a8f8df-4e88-4527-820c-cf75b539c779 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:28.482070 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-8e05269b-a02f-492b-ad00-fa67cb9ff00c req-15c8afd5-9631-4c74-8a34-a2e1a9490ecd service nova] Creating event network-vif-deleted:4ed06e43-5924-4dd9-b9a7-e0cbcd55d744 for instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff on hv-cinder-85032 Sep 09 23:26:28.489169 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-8e05269b-a02f-492b-ad00-fa67cb9ff00c req-15c8afd5-9631-4c74-8a34-a2e1a9490ecd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035741 Sep 09 23:26:28.490094 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 331/642] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:28.517656 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-01a8f8df-4e88-4527-820c-cf75b539c779 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.081395 Sep 09 23:26:28.523704 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 312/643] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Sep 9 23:26:28 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:28.536357 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7394edf2-63de-4b56-ac9d-5a215c331488 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:28.539962 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7394edf2-63de-4b56-ac9d-5a215c331488 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:28.546931 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7394edf2-63de-4b56-ac9d-5a215c331488 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:28.551049 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7394edf2-63de-4b56-ac9d-5a215c331488 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:28.554025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7394edf2-63de-4b56-ac9d-5a215c331488 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:28.555101 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7394edf2-63de-4b56-ac9d-5a215c331488 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:28.555729 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7394edf2-63de-4b56-ac9d-5a215c331488 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:28.558026 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7394edf2-63de-4b56-ac9d-5a215c331488 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:28.581624 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3554bd65-f1e1-4aa8-90a9-e826bdae88c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:28.582254 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3554bd65-f1e1-4aa8-90a9-e826bdae88c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:28.590528 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3554bd65-f1e1-4aa8-90a9-e826bdae88c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:28.595281 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3554bd65-f1e1-4aa8-90a9-e826bdae88c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:28.596828 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3554bd65-f1e1-4aa8-90a9-e826bdae88c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:28.596828 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3554bd65-f1e1-4aa8-90a9-e826bdae88c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:28.597504 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3554bd65-f1e1-4aa8-90a9-e826bdae88c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:28.598113 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3554bd65-f1e1-4aa8-90a9-e826bdae88c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:28.655844 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3554bd65-f1e1-4aa8-90a9-e826bdae88c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:28.656570 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3554bd65-f1e1-4aa8-90a9-e826bdae88c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:28.657389 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3554bd65-f1e1-4aa8-90a9-e826bdae88c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:28.657997 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-3554bd65-f1e1-4aa8-90a9-e826bdae88c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lazy-loading 'fault' on Instance uuid e56bd49b-8d5d-4de6-a394-2d097824a7c4 {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:26:28.719301 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3554bd65-f1e1-4aa8-90a9-e826bdae88c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:28.728049 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3554bd65-f1e1-4aa8-90a9-e826bdae88c6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 200 len: 1328 microversion: 2.1 time: 0.150187 Sep 09 23:26:28.738403 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 313/644] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:28 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 1328 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:28.738403 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b37b2016-7142-4fb4-be34-4d33212c23b4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:28.738403 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b37b2016-7142-4fb4-be34-4d33212c23b4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:28.746757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7394edf2-63de-4b56-ac9d-5a215c331488 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:28.751491 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b37b2016-7142-4fb4-be34-4d33212c23b4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:28.751936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b37b2016-7142-4fb4-be34-4d33212c23b4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:28.752385 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b37b2016-7142-4fb4-be34-4d33212c23b4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:28.756578 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7394edf2-63de-4b56-ac9d-5a215c331488 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1358 microversion: 2.1 time: 0.224800 Sep 09 23:26:28.757085 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 332/645] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:28 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:28.758903 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b37b2016-7142-4fb4-be34-4d33212c23b4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:28.759398 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b37b2016-7142-4fb4-be34-4d33212c23b4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:28.759847 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b37b2016-7142-4fb4-be34-4d33212c23b4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:28.789915 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b37b2016-7142-4fb4-be34-4d33212c23b4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Going to try to terminate instance {{(pid=121058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:26:28.955802 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:29.011556 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b37b2016-7142-4fb4-be34-4d33212c23b4 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 204 len: 0 microversion: 2.20 time: 0.280834 Sep 09 23:26:29.012696 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 314/646] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Sep 9 23:26:28 2022] DELETE /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 23:26:29.021423 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-91c891df-c6b9-4c5b-a7a1-783462dfa802 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:29.022041 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-91c891df-c6b9-4c5b-a7a1-783462dfa802 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:29.028589 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-91c891df-c6b9-4c5b-a7a1-783462dfa802 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:29.030161 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-91c891df-c6b9-4c5b-a7a1-783462dfa802 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:29.030161 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-91c891df-c6b9-4c5b-a7a1-783462dfa802 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:29.030375 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-91c891df-c6b9-4c5b-a7a1-783462dfa802 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:29.030675 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-91c891df-c6b9-4c5b-a7a1-783462dfa802 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:29.031100 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-91c891df-c6b9-4c5b-a7a1-783462dfa802 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:29.170842 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7e96fbed-52d2-4125-a266-a1bd10848cb7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:29.171294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-91c891df-c6b9-4c5b-a7a1-783462dfa802 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:29.173555 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7e96fbed-52d2-4125-a266-a1bd10848cb7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:29.178057 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7e96fbed-52d2-4125-a266-a1bd10848cb7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:29.178629 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7e96fbed-52d2-4125-a266-a1bd10848cb7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:29.179064 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7e96fbed-52d2-4125-a266-a1bd10848cb7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:29.179768 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7e96fbed-52d2-4125-a266-a1bd10848cb7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:29.180218 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7e96fbed-52d2-4125-a266-a1bd10848cb7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:29.180738 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7e96fbed-52d2-4125-a266-a1bd10848cb7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:29.184036 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-91c891df-c6b9-4c5b-a7a1-783462dfa802 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:29.187790 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-91c891df-c6b9-4c5b-a7a1-783462dfa802 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:29.189197 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-91c891df-c6b9-4c5b-a7a1-783462dfa802 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.171816 Sep 09 23:26:29.202365 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 333/647] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:29 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:29.221154 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7e96fbed-52d2-4125-a266-a1bd10848cb7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:29.221727 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7e96fbed-52d2-4125-a266-a1bd10848cb7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:29.222331 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7e96fbed-52d2-4125-a266-a1bd10848cb7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:29.222808 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-7e96fbed-52d2-4125-a266-a1bd10848cb7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lazy-loading 'fault' on Instance uuid 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:26:29.287864 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7e96fbed-52d2-4125-a266-a1bd10848cb7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:29.297729 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7e96fbed-52d2-4125-a266-a1bd10848cb7 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1334 microversion: 2.1 time: 0.131925 Sep 09 23:26:29.302385 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 315/648] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:29 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1334 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:29.315427 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2087997213", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-469023736", "security_groups": [{"name": "tempest-secgroup-smoke-541902200"}], "networks": [{"uuid": "9934a24b-bcbf-4e09-838f-1bbd03dadd7a"}], "block_device_mapping_v2": [{"uuid": "d42ff407-a2f8-4983-a5b1-0394f9113068", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:29.454448 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.network.neutron [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] validate_networks() for [('9934a24b-bcbf-4e09-838f-1bbd03dadd7a', None, None, None, None, None)] {{(pid=121059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:26:29.754327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-f7968629-18e5-4270-94dd-6053e61bd1de tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:29.754970 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-f7968629-18e5-4270-94dd-6053e61bd1de tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:29.761262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f7968629-18e5-4270-94dd-6053e61bd1de tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:29.761749 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f7968629-18e5-4270-94dd-6053e61bd1de tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:29.762191 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f7968629-18e5-4270-94dd-6053e61bd1de tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:29.762911 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f7968629-18e5-4270-94dd-6053e61bd1de tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:29.763368 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f7968629-18e5-4270-94dd-6053e61bd1de tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:29.764985 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f7968629-18e5-4270-94dd-6053e61bd1de tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:29.769200 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:29.778930 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-f7968629-18e5-4270-94dd-6053e61bd1de tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] HTTP exception thrown: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-f7968629-18e5-4270-94dd-6053e61bd1de tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Request method failure captured: Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 HTTP/1.1 Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8pwuR6kqc7k0stDLKdFO4Ckk0gymyfMjIdGenSRMfvp5f3MJkij-SA0jpro4oueYSNQT201tvFKNLp_zoiAVeIBUcez9Cupz75IOKVWJp9SMAptEU2dx_Fm6ZH14If3_21qeS5XMAwu28pXoKNydVEVNi9I0hMe3b6lKrxXSIdkEpg Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 5c3517b03576446a902816ab0bbff2e7 Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:26:29.783310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:26:29.784939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c3517b03576446a902816ab0bbff2e7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:26:29.784939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:26:29.784939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 5c3517b03576446a902816ab0bbff2e7 Sep 09 23:26:29.784939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:26:29.784939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-AttachVolumeTestJSON-1262781169-project Sep 09 23:26:29.784939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:26:29.784939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:26:29.784939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: f097c4fc270748cc8d41d7bcaba672a7 Sep 09 23:26:29.784939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-AttachVolumeTestJSON-1262781169-project Sep 09 23:26:29.784939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:26:29.784939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. Sep 09 23:26:29.784939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': 'e56bd49b-8d5d-4de6-a394-2d097824a7c4'} Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:26:29.785914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. Sep 09 23:26:29.787591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:29.788927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-f7968629-18e5-4270-94dd-6053e61bd1de tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Returning 404 to user: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:26:29.788927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-f7968629-18e5-4270-94dd-6053e61bd1de tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 404 len: 111 microversion: 2.1 time: 0.034350 Sep 09 23:26:29.788927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 316/649] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:29 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:26:29.789908 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-41b3ada0-1db6-4d7f-98ff-8024470af5aa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:29.790547 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-41b3ada0-1db6-4d7f-98ff-8024470af5aa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:29.798269 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41b3ada0-1db6-4d7f-98ff-8024470af5aa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:29.800744 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41b3ada0-1db6-4d7f-98ff-8024470af5aa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:29.800744 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41b3ada0-1db6-4d7f-98ff-8024470af5aa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:29.800744 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41b3ada0-1db6-4d7f-98ff-8024470af5aa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:29.800744 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41b3ada0-1db6-4d7f-98ff-8024470af5aa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:29.801252 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-41b3ada0-1db6-4d7f-98ff-8024470af5aa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:29.887915 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Flavor limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:26:29.888376 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Image limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:26:29.889526 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Flavor pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:26:29.889941 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Image pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:26:29.890368 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:26:29.899237 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:29.899725 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:29.900160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:29.900887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:29.901351 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:29.901776 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:29.918841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Getting quotas for project 602875e689b7476697ce2e9bbc3bf7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:26:29.923565 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Getting quotas for user cf9d4a796a8c450486832bb10c3d4ad0 and project 602875e689b7476697ce2e9bbc3bf7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:26:29.937432 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-41b3ada0-1db6-4d7f-98ff-8024470af5aa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:29.945297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-41b3ada0-1db6-4d7f-98ff-8024470af5aa tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1547 microversion: 2.1 time: 0.159022 Sep 09 23:26:29.946041 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 317/650] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:29 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:29.950633 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-fbd8d8ac-4887-4433-8fc9-d6b9f1aa2c9b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '.version_select at 0x7f908dc5c940>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:29.984794 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Going to run 1 instances... {{(pid=121059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:26:29.986990 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d42ff407-a2f8-4983-a5b1-0394f9113068',volume_size=None,volume_type=None)] {{(pid=121059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:26:30.014467 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-fbd8d8ac-4887-4433-8fc9-d6b9f1aa2c9b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411375985" status: 202 len: 0 microversion: 2.1 time: 0.065680 Sep 09 23:26:30.015168 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 318/651] 10.222.0.20 () {58 vars in 1221 bytes} [Fri Sep 9 23:26:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411375985 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:26:30.020542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7d16eb62-a746-4635-bcfc-d7344699fdef tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:30.024411 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7d16eb62-a746-4635-bcfc-d7344699fdef tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:30.027653 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d16eb62-a746-4635-bcfc-d7344699fdef tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:30.028215 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d16eb62-a746-4635-bcfc-d7344699fdef tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:30.028716 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d16eb62-a746-4635-bcfc-d7344699fdef tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:30.029542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d16eb62-a746-4635-bcfc-d7344699fdef tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:30.030208 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d16eb62-a746-4635-bcfc-d7344699fdef tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:30.030746 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d16eb62-a746-4635-bcfc-d7344699fdef tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:30.225066 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7d16eb62-a746-4635-bcfc-d7344699fdef tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:30.234294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7d16eb62-a746-4635-bcfc-d7344699fdef tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1547 microversion: 2.1 time: 0.216829 Sep 09 23:26:30.234876 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 319/652] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:30 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1547 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:30.239320 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0a4f02f9-74ef-4ed9-b407-748577d3ed90 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:30.239943 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0a4f02f9-74ef-4ed9-b407-748577d3ed90 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:30.245708 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a4f02f9-74ef-4ed9-b407-748577d3ed90 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:30.246188 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a4f02f9-74ef-4ed9-b407-748577d3ed90 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:30.246657 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a4f02f9-74ef-4ed9-b407-748577d3ed90 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:30.247342 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a4f02f9-74ef-4ed9-b407-748577d3ed90 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:30.247789 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a4f02f9-74ef-4ed9-b407-748577d3ed90 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:30.248873 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a4f02f9-74ef-4ed9-b407-748577d3ed90 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:30.327341 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:30.430945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0a4f02f9-74ef-4ed9-b407-748577d3ed90 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:30.443460 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0a4f02f9-74ef-4ed9-b407-748577d3ed90 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:30.445008 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0a4f02f9-74ef-4ed9-b407-748577d3ed90 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:30.446248 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0a4f02f9-74ef-4ed9-b407-748577d3ed90 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.210443 Sep 09 23:26:30.456225 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 320/653] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:30 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:30.461693 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-85d20366-f8a1-45cc-a540-bd4a7cc5c4d0 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.149520 Sep 09 23:26:30.462166 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-71c18635-dbd6-46e2-aba5-167bf6fc8826 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:30.463550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 334/654] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:26:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:26:30.474281 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f8dbe608-f0b9-4564-884d-a688956134be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:30.475178 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f8dbe608-f0b9-4564-884d-a688956134be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:30.476053 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-71c18635-dbd6-46e2-aba5-167bf6fc8826 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:30.476951 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-71c18635-dbd6-46e2-aba5-167bf6fc8826 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Searching by: {'deleted': False, 'project_id': '28d0bb1d968841c2986b5eb164af953b'} {{(pid=121058) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 09 23:26:30.485195 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71c18635-dbd6-46e2-aba5-167bf6fc8826 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:30.485840 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71c18635-dbd6-46e2-aba5-167bf6fc8826 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:30.486288 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71c18635-dbd6-46e2-aba5-167bf6fc8826 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:30.486584 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8dbe608-f0b9-4564-884d-a688956134be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:30.487407 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71c18635-dbd6-46e2-aba5-167bf6fc8826 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:30.487584 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8dbe608-f0b9-4564-884d-a688956134be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:30.487778 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71c18635-dbd6-46e2-aba5-167bf6fc8826 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:30.488216 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71c18635-dbd6-46e2-aba5-167bf6fc8826 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:30.489129 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8dbe608-f0b9-4564-884d-a688956134be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:30.491318 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8dbe608-f0b9-4564-884d-a688956134be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:30.492564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8dbe608-f0b9-4564-884d-a688956134be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:30.493105 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8dbe608-f0b9-4564-884d-a688956134be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:30.546567 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8dbe608-f0b9-4564-884d-a688956134be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:30.547261 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8dbe608-f0b9-4564-884d-a688956134be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:30.547765 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8dbe608-f0b9-4564-884d-a688956134be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:30.548349 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-f8dbe608-f0b9-4564-884d-a688956134be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lazy-loading 'fault' on Instance uuid 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:26:30.618256 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f8dbe608-f0b9-4564-884d-a688956134be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:30.619343 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.multi_cell_list [None req-71c18635-dbd6-46e2-aba5-167bf6fc8826 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121058) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 09 23:26:30.633298 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f8dbe608-f0b9-4564-884d-a688956134be tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 200 len: 1334 microversion: 2.1 time: 0.167832 Sep 09 23:26:30.635728 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 335/655] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:30 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 1334 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:30.641928 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-655df42c-23d2-40ee-8384-f48d3c8098c9 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:30.642870 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-655df42c-23d2-40ee-8384-f48d3c8098c9 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:30.715262 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-655df42c-23d2-40ee-8384-f48d3c8098c9 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:30.732974 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-655df42c-23d2-40ee-8384-f48d3c8098c9 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1088 microversion: 2.1 time: 0.095441 Sep 09 23:26:30.733980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 336/656] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:30 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1088 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:30.759452 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-71c18635-dbd6-46e2-aba5-167bf6fc8826 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.301424 Sep 09 23:26:30.760194 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 321/657] 10.222.0.20 () {58 vars in 1125 bytes} [Fri Sep 9 23:26:30 2022] GET /compute/v2.1/servers => generated 342 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:30.773041 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d9d98613-0dbc-46c4-9526-0cdfba3efd91 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:30.774258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d9d98613-0dbc-46c4-9526-0cdfba3efd91 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:30.784394 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d9d98613-0dbc-46c4-9526-0cdfba3efd91 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:30.785276 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d9d98613-0dbc-46c4-9526-0cdfba3efd91 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:30.785718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d9d98613-0dbc-46c4-9526-0cdfba3efd91 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:30.786508 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d9d98613-0dbc-46c4-9526-0cdfba3efd91 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:30.787138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d9d98613-0dbc-46c4-9526-0cdfba3efd91 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:30.787561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d9d98613-0dbc-46c4-9526-0cdfba3efd91 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:30.987316 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d9d98613-0dbc-46c4-9526-0cdfba3efd91 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:30.996736 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d9d98613-0dbc-46c4-9526-0cdfba3efd91 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1547 microversion: 2.1 time: 0.227996 Sep 09 23:26:30.997363 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 337/658] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:30 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1547 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:31.164239 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-666139e4-e619-4d18-a505-843019052b60 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Action: 'create', calling method: .version_select at 0x7f908dcacdc0>, body: {"keypair": {"name": "tempest-keypair-1585560311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6u2gN9ggsRF5eulfQySz4W0kl73n5nut6BxarIPx8/RlQqQp4r1ze/IGjedTG7YwNFT2Ot4pXNEoR3aYin7HbVES8SrMrFhVJ5WiT73oz4ZwivTp4ZWGcyaOwrZ7kynA=="}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:31.188583 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-666139e4-e619-4d18-a505-843019052b60 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Getting quotas for project 5c3517b03576446a902816ab0bbff2e7. Resources: {'key_pairs'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:26:31.188840 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-666139e4-e619-4d18-a505-843019052b60 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Getting quotas for user f097c4fc270748cc8d41d7bcaba672a7 and project 5c3517b03576446a902816ab0bbff2e7. Resources: {'key_pairs'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:26:31.322739 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-666139e4-e619-4d18-a505-843019052b60 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159729 Sep 09 23:26:31.323703 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 322/659] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 23:26:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:31.477241 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-59edea02-9df6-4ffe-9425-eb5182561c32 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:31.478183 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-59edea02-9df6-4ffe-9425-eb5182561c32 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:31.488043 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-59edea02-9df6-4ffe-9425-eb5182561c32 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:31.492497 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-59edea02-9df6-4ffe-9425-eb5182561c32 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:31.492497 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-59edea02-9df6-4ffe-9425-eb5182561c32 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:31.492497 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-59edea02-9df6-4ffe-9425-eb5182561c32 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:31.492497 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-59edea02-9df6-4ffe-9425-eb5182561c32 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:31.492820 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-59edea02-9df6-4ffe-9425-eb5182561c32 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:31.662043 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4e9b904c-ce83-431d-9293-92bb049bc4b9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:31.663367 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4e9b904c-ce83-431d-9293-92bb049bc4b9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:31.677047 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4e9b904c-ce83-431d-9293-92bb049bc4b9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:31.677795 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4e9b904c-ce83-431d-9293-92bb049bc4b9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:31.678509 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4e9b904c-ce83-431d-9293-92bb049bc4b9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:31.678640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-59edea02-9df6-4ffe-9425-eb5182561c32 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:31.679561 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4e9b904c-ce83-431d-9293-92bb049bc4b9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:31.680216 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4e9b904c-ce83-431d-9293-92bb049bc4b9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:31.680838 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4e9b904c-ce83-431d-9293-92bb049bc4b9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:31.688090 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-59edea02-9df6-4ffe-9425-eb5182561c32 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:31.689986 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-59edea02-9df6-4ffe-9425-eb5182561c32 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:31.691409 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-59edea02-9df6-4ffe-9425-eb5182561c32 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1717 microversion: 2.20 time: 0.218426 Sep 09 23:26:31.692319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 338/660] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:31 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1717 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:31.702190 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-4e9b904c-ce83-431d-9293-92bb049bc4b9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] HTTP exception thrown: Instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff could not be found. Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4e9b904c-ce83-431d-9293-92bb049bc4b9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Request method failure captured: Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff HTTP/1.1 Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8pvNjLzJ26L_bDfYD8jco5ncLw5obm7RC4wRKucPyVFopv8LyYjnV_yhQPQAMGp6Zil82MDNt-pAuesw1hNYtsUzcK3dtyAhtCRZHB6fsXyFIBBtemCyksfm8yeHS53wmAq7bbGmXxhGwRUbZisQhpK4e3SQrT2dZnXAXnSUbLamlo Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 57759aec45f74a689727fca5fe201e40 Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-180796804 Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:26:31.704005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:26:31.705324 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57759aec45f74a689727fca5fe201e40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57759aec45f74a689727fca5fe201e40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57759aec45f74a689727fca5fe201e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57759aec45f74a689727fca5fe201e40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:26:31.705324 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-ServerRescueNegativeTestJSON-180796804 Sep 09 23:26:31.705324 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 57759aec45f74a689727fca5fe201e40 Sep 09 23:26:31.705324 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-180796804 Sep 09 23:26:31.705324 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-ServerRescueNegativeTestJSON-180796804-project Sep 09 23:26:31.705324 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:26:31.705324 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:26:31.705324 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 987d2f6bb1ff4f1fa248c3ff410c8119 Sep 09 23:26:31.705324 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-ServerRescueNegativeTestJSON-180796804-project Sep 09 23:26:31.705324 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:26:31.705324 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff could not be found. Sep 09 23:26:31.705324 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff'} Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff could not be found. Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:26:31.706122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff could not be found. Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff could not be found. Sep 09 23:26:31.707299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:31.708319 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4e9b904c-ce83-431d-9293-92bb049bc4b9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Returning 404 to user: Instance 8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:26:31.708319 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4e9b904c-ce83-431d-9293-92bb049bc4b9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff" status: 404 len: 111 microversion: 2.1 time: 0.048383 Sep 09 23:26:31.714824 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-72699e82-5f14-4710-b835-26e9ce036aa5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '.version_select at 0x7f908dc6fe50>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:31.719525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 323/661] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:31 2022] GET /compute/v2.1/servers/8b5bfcb2-3daa-437c-b4f5-c1d7764ffcff => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:26:31.758063 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ca63a0cc-b4d4-4a17-a9ac-ee46bae06d40 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:31.758717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ca63a0cc-b4d4-4a17-a9ac-ee46bae06d40 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:31.790197 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-72699e82-5f14-4710-b835-26e9ce036aa5 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-369746703" status: 202 len: 0 microversion: 2.1 time: 0.079654 Sep 09 23:26:31.791093 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 339/662] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Sep 9 23:26:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-369746703 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:26:31.847718 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ca63a0cc-b4d4-4a17-a9ac-ee46bae06d40 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:31.856558 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ca63a0cc-b4d4-4a17-a9ac-ee46bae06d40 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1088 microversion: 2.1 time: 0.102209 Sep 09 23:26:31.859190 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 324/663] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:31 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1088 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:32.360424 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-9978f686-59b7-4e06-ad5b-af0d9300a0fe req-5b4fae2e-92ea-4aea-9bbb-c927cb92e946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a8b2e1-79be-4c0d-b316-94c95ae04638", "name": "network-vif-deleted", "tag": "a8c73f48-9a44-48f9-9123-64c486486e8b"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:32.381804 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-9978f686-59b7-4e06-ad5b-af0d9300a0fe req-5b4fae2e-92ea-4aea-9bbb-c927cb92e946 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:32.382585 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-9978f686-59b7-4e06-ad5b-af0d9300a0fe req-5b4fae2e-92ea-4aea-9bbb-c927cb92e946 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:32.383813 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-9978f686-59b7-4e06-ad5b-af0d9300a0fe req-5b4fae2e-92ea-4aea-9bbb-c927cb92e946 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:32.402332 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-9978f686-59b7-4e06-ad5b-af0d9300a0fe req-5b4fae2e-92ea-4aea-9bbb-c927cb92e946 service nova] Creating event network-vif-deleted:a8c73f48-9a44-48f9-9123-64c486486e8b for instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 on hv-cinder-85032 Sep 09 23:26:32.410512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-9978f686-59b7-4e06-ad5b-af0d9300a0fe req-5b4fae2e-92ea-4aea-9bbb-c927cb92e946 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056116 Sep 09 23:26:32.411511 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 340/664] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:32.721960 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:32.722511 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:32.742036 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:32.749248 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:32.749248 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:32.749248 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:32.749248 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:32.749906 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:32.797119 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:32.797617 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:32.798130 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:32.798529 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lazy-loading 'fault' on Instance uuid 61a8b2e1-79be-4c0d-b316-94c95ae04638 {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:26:32.881229 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-9ac86a5a-62c2-4039-978d-cf8dd34d4ea9 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:32.882178 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-9ac86a5a-62c2-4039-978d-cf8dd34d4ea9 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:32.896890 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9ac86a5a-62c2-4039-978d-cf8dd34d4ea9 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:32.897653 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9ac86a5a-62c2-4039-978d-cf8dd34d4ea9 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:32.898477 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:32.899057 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9ac86a5a-62c2-4039-978d-cf8dd34d4ea9 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:32.903049 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9ac86a5a-62c2-4039-978d-cf8dd34d4ea9 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:32.904023 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9ac86a5a-62c2-4039-978d-cf8dd34d4ea9 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:32.905507 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9ac86a5a-62c2-4039-978d-cf8dd34d4ea9 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:32.913018 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:32.929866 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:32.929866 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-71196e8c-5288-4623-8bf3-f2d399b12acd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1367 microversion: 2.20 time: 0.201765 Sep 09 23:26:32.930285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:32.932152 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 325/665] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:32 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:33.054209 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-9ac86a5a-62c2-4039-978d-cf8dd34d4ea9 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:33.064814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-9ac86a5a-62c2-4039-978d-cf8dd34d4ea9 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1186 microversion: 2.1 time: 0.187955 Sep 09 23:26:33.068325 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 341/666] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:32 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1186 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:33.234488 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-01d5961e-84fd-49c9-9301-df16c0453bad tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "348d5f71-950c-4545-b610-27c18a0df60e"}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:33.240140 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-01d5961e-84fd-49c9-9301-df16c0453bad tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:33.243492 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01d5961e-84fd-49c9-9301-df16c0453bad tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:33.244061 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01d5961e-84fd-49c9-9301-df16c0453bad tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:33.244575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01d5961e-84fd-49c9-9301-df16c0453bad tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:33.245273 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01d5961e-84fd-49c9-9301-df16c0453bad tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:33.245735 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01d5961e-84fd-49c9-9301-df16c0453bad tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:33.246199 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01d5961e-84fd-49c9-9301-df16c0453bad tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:33.958039 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:33.958709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:33.966143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:33.966838 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:33.967552 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:33.967920 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:33.968370 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:33.968986 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:34.007082 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:34.007570 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:34.008000 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:34.008451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lazy-loading 'fault' on Instance uuid 61a8b2e1-79be-4c0d-b316-94c95ae04638 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:26:34.054485 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:34.064406 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:34.065880 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:34.067331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-cef3135a-db4e-44f8-b2bc-aa32d373515f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 200 len: 1367 microversion: 2.20 time: 0.113593 Sep 09 23:26:34.068134 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 342/667] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:33 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 1367 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:26:34.089793 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-85f82712-d6e2-4626-9389-85537a2dce79 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:34.090420 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-85f82712-d6e2-4626-9389-85537a2dce79 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:34.096411 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85f82712-d6e2-4626-9389-85537a2dce79 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:34.097493 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85f82712-d6e2-4626-9389-85537a2dce79 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:34.097930 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85f82712-d6e2-4626-9389-85537a2dce79 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:34.098647 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85f82712-d6e2-4626-9389-85537a2dce79 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:34.099282 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85f82712-d6e2-4626-9389-85537a2dce79 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:34.099703 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85f82712-d6e2-4626-9389-85537a2dce79 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:34.131783 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-01d5961e-84fd-49c9-9301-df16c0453bad tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "POST /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.903836 Sep 09 23:26:34.135412 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 326/668] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 23:26:33 2022] POST /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/os-volume_attachments => generated 194 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:34.173422 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-85f82712-d6e2-4626-9389-85537a2dce79 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:34.181607 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-85f82712-d6e2-4626-9389-85537a2dce79 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1204 microversion: 2.1 time: 0.096451 Sep 09 23:26:34.190295 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 343/669] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:34 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:34.538107 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1237029346", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "471c0a9c-07f4-4630-8d7a-4695d6b4f22d"}], "security_groups": [{"name": "tempest-securitygroup--903364300"}], "key_name": "tempest-keypair-1585560311", "user_data": "}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:34.715670 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.network.neutron [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] validate_networks() for [('471c0a9c-07f4-4630-8d7a-4695d6b4f22d', None, None, None, None, None)] {{(pid=121058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:26:35.095311 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0b513351-b6db-4d99-ba69-30a422feb17b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:35.095965 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-0b513351-b6db-4d99-ba69-30a422feb17b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:35.114594 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0b513351-b6db-4d99-ba69-30a422feb17b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:35.115099 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0b513351-b6db-4d99-ba69-30a422feb17b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:35.115534 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0b513351-b6db-4d99-ba69-30a422feb17b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:35.116528 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0b513351-b6db-4d99-ba69-30a422feb17b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:35.117163 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0b513351-b6db-4d99-ba69-30a422feb17b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:35.117739 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0b513351-b6db-4d99-ba69-30a422feb17b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:35.134574 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-0b513351-b6db-4d99-ba69-30a422feb17b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] HTTP exception thrown: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0b513351-b6db-4d99-ba69-30a422feb17b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Request method failure captured: Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 HTTP/1.1 Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8q5F4aEPp2xsaUOSTg_jeMQB6rQi2QUkVY7eUq1059hz2EVu45WV59Y73UeLvRk4rYN6DeCLjCPJZO6yv1D2W5oEeMEr_K_f4bBAe9Pa7wNZD-Rm9WAv8CpL78JF3AkWSsj5UgG7QWNBfbEWiyacgNTWAbUDdmXZjbVcAou5GgtPsg Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: fbe6c3ad574e46fd9d3b37ead0542a18 Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:26:35.136665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:26:35.138062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fbe6c3ad574e46fd9d3b37ead0542a18", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:26:35.138062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:26:35.138062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: fbe6c3ad574e46fd9d3b37ead0542a18 Sep 09 23:26:35.138062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:26:35.138062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeShelveTestJSON-2105690103-project Sep 09 23:26:35.138062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:26:35.138062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:26:35.138062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 27be0979440d4ab081dae31790280eff Sep 09 23:26:35.138062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2105690103-project Sep 09 23:26:35.138062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:26:35.138062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. Sep 09 23:26:35.138062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '61a8b2e1-79be-4c0d-b316-94c95ae04638'} Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:26:35.139709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. Sep 09 23:26:35.142918 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:35.144309 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0b513351-b6db-4d99-ba69-30a422feb17b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Returning 404 to user: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:26:35.144309 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-0b513351-b6db-4d99-ba69-30a422feb17b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 404 len: 111 microversion: 2.20 time: 0.046942 Sep 09 23:26:35.144309 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 344/670] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:35 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 09 23:26:35.147695 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-439552ea-3ad8-4b51-ba19-382d99f9cd62 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '.version_select at 0x7f908dc629d0>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:35.265082 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-439552ea-3ad8-4b51-ba19-382d99f9cd62 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-3669047" status: 204 len: 0 microversion: 2.20 time: 0.120434 Sep 09 23:26:35.266503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 345/671] 10.222.0.20 () {60 vars in 1253 bytes} [Fri Sep 9 23:26:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-3669047 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 23:26:35.272718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5e9c3802-f2bf-4046-a235-b9f4ff83c421 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:35.273340 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5e9c3802-f2bf-4046-a235-b9f4ff83c421 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:35.282494 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5e9c3802-f2bf-4046-a235-b9f4ff83c421 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:35.283289 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5e9c3802-f2bf-4046-a235-b9f4ff83c421 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:35.283953 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5e9c3802-f2bf-4046-a235-b9f4ff83c421 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:35.286535 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5e9c3802-f2bf-4046-a235-b9f4ff83c421 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:35.287405 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5e9c3802-f2bf-4046-a235-b9f4ff83c421 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:35.288081 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5e9c3802-f2bf-4046-a235-b9f4ff83c421 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:35.308140 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Flavor limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:26:35.308611 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Image limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:26:35.309028 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Flavor pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:26:35.309436 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Image pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:26:35.309855 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:26:35.326738 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:35.327419 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:35.327903 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:35.328635 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:35.329896 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:35.330718 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:35.354318 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Getting quotas for project 5c3517b03576446a902816ab0bbff2e7. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:26:35.359728 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Getting quotas for user f097c4fc270748cc8d41d7bcaba672a7 and project 5c3517b03576446a902816ab0bbff2e7. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:26:35.376879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Going to run 1 instances... {{(pid=121058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:26:35.379651 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:26:35.488775 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-dbf82413-1b5e-4558-b266-aac20da30355 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.956049 Sep 09 23:26:35.489427 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 327/672] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:26:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:26:35.506679 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c143cc34-8017-47f1-a895-dd894bc3c531 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:35.507674 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c143cc34-8017-47f1-a895-dd894bc3c531 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:35.530560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5e9c3802-f2bf-4046-a235-b9f4ff83c421 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:35.538898 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5e9c3802-f2bf-4046-a235-b9f4ff83c421 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1259 microversion: 2.1 time: 0.271225 Sep 09 23:26:35.559422 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 346/673] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:35 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1259 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:35.618358 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c143cc34-8017-47f1-a895-dd894bc3c531 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:35.635071 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c143cc34-8017-47f1-a895-dd894bc3c531 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1238 microversion: 2.1 time: 0.137860 Sep 09 23:26:35.637144 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 328/674] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:35 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1238 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:35.637467 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c280e357-b5a4-43db-8918-da8e5dcb0766 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:35.637970 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-c280e357-b5a4-43db-8918-da8e5dcb0766 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:35.650930 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c280e357-b5a4-43db-8918-da8e5dcb0766 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:35.651433 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c280e357-b5a4-43db-8918-da8e5dcb0766 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:35.651886 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c280e357-b5a4-43db-8918-da8e5dcb0766 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:35.652602 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c280e357-b5a4-43db-8918-da8e5dcb0766 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:35.653065 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c280e357-b5a4-43db-8918-da8e5dcb0766 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:35.653497 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c280e357-b5a4-43db-8918-da8e5dcb0766 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:35.692820 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-c280e357-b5a4-43db-8918-da8e5dcb0766 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Going to try to terminate instance {{(pid=121059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:26:36.023023 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-c280e357-b5a4-43db-8918-da8e5dcb0766 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 204 len: 0 microversion: 2.1 time: 0.389210 Sep 09 23:26:36.023619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 347/675] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:26:35 2022] DELETE /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 23:26:36.032315 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5aa92f8d-5468-44b0-ab91-678e6eb092e9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:36.033208 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5aa92f8d-5468-44b0-ab91-678e6eb092e9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:36.041112 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5aa92f8d-5468-44b0-ab91-678e6eb092e9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:36.042268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5aa92f8d-5468-44b0-ab91-678e6eb092e9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:36.042899 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5aa92f8d-5468-44b0-ab91-678e6eb092e9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:36.044453 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5aa92f8d-5468-44b0-ab91-678e6eb092e9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:36.045651 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5aa92f8d-5468-44b0-ab91-678e6eb092e9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:36.046715 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5aa92f8d-5468-44b0-ab91-678e6eb092e9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:36.226875 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3996718d-f48c-4a0c-86fd-2c0e78d63294 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Action: 'create', calling method: .version_select at 0x7f908dc60e50>, body: {"keypair": {"name": "tempest-keypair-1274619386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/pg/2LIyslpy5Kft2Vhw1X8ElYTsSeUBakD/DglhsREGN+MYiGKDr0RPiJTSdbTZnW/fEx8bzGtIEhb/cukGX/Fahwa0fQmrpl0tZ5g249Y7PUjQFDjMN9X30mDVKeEQ=="}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:36.244342 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-3996718d-f48c-4a0c-86fd-2c0e78d63294 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Getting quotas for project fbe6c3ad574e46fd9d3b37ead0542a18. Resources: {'key_pairs'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:26:36.248319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-3996718d-f48c-4a0c-86fd-2c0e78d63294 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Getting quotas for user 27be0979440d4ab081dae31790280eff and project fbe6c3ad574e46fd9d3b37ead0542a18. Resources: {'key_pairs'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:26:36.258882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5aa92f8d-5468-44b0-ab91-678e6eb092e9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:36.268846 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5aa92f8d-5468-44b0-ab91-678e6eb092e9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1507 microversion: 2.1 time: 0.241065 Sep 09 23:26:36.269470 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 329/676] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:36 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:36.346957 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3996718d-f48c-4a0c-86fd-2c0e78d63294 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.123545 Sep 09 23:26:36.347905 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 348/677] 10.222.0.20 () {62 vars in 1200 bytes} [Fri Sep 9 23:26:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 09 23:26:36.445462 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-5655aecc-03d5-47aa-9965-06114302acd3 req-49efd30f-b5f6-4027-a5e6-3c58c6edeb92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d367ef-58a3-46c5-94d6-8723e6cca32b", "tag": "c92b2495-b9d4-4026-960c-2b98f517147e"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:36.455709 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-5655aecc-03d5-47aa-9965-06114302acd3 req-49efd30f-b5f6-4027-a5e6-3c58c6edeb92 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:36.456193 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-5655aecc-03d5-47aa-9965-06114302acd3 req-49efd30f-b5f6-4027-a5e6-3c58c6edeb92 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:36.456629 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-5655aecc-03d5-47aa-9965-06114302acd3 req-49efd30f-b5f6-4027-a5e6-3c58c6edeb92 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:36.469501 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-5655aecc-03d5-47aa-9965-06114302acd3 req-49efd30f-b5f6-4027-a5e6-3c58c6edeb92 service nova] Creating event network-changed:c92b2495-b9d4-4026-960c-2b98f517147e for instance 77d367ef-58a3-46c5-94d6-8723e6cca32b on hv-cinder-85032 Sep 09 23:26:36.475658 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-5655aecc-03d5-47aa-9965-06114302acd3 req-49efd30f-b5f6-4027-a5e6-3c58c6edeb92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100222 Sep 09 23:26:36.476269 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 330/678] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:36.565608 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-33c20f14-19f3-4ed6-9bc9-a4bb8963ba27 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:36.566371 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-33c20f14-19f3-4ed6-9bc9-a4bb8963ba27 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:36.573085 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-33c20f14-19f3-4ed6-9bc9-a4bb8963ba27 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:36.573570 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-33c20f14-19f3-4ed6-9bc9-a4bb8963ba27 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:36.574184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-33c20f14-19f3-4ed6-9bc9-a4bb8963ba27 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:36.574912 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-33c20f14-19f3-4ed6-9bc9-a4bb8963ba27 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:36.575369 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-33c20f14-19f3-4ed6-9bc9-a4bb8963ba27 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:36.575902 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-33c20f14-19f3-4ed6-9bc9-a4bb8963ba27 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:36.660468 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-25762a47-b56c-43af-9775-b8ad4a0c0e40 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:36.661178 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-25762a47-b56c-43af-9775-b8ad4a0c0e40 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:36.667840 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-25762a47-b56c-43af-9775-b8ad4a0c0e40 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:36.668602 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-25762a47-b56c-43af-9775-b8ad4a0c0e40 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:36.669245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-25762a47-b56c-43af-9775-b8ad4a0c0e40 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:36.670204 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-25762a47-b56c-43af-9775-b8ad4a0c0e40 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:36.670879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-25762a47-b56c-43af-9775-b8ad4a0c0e40 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:36.671495 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-25762a47-b56c-43af-9775-b8ad4a0c0e40 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:36.716234 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-33c20f14-19f3-4ed6-9bc9-a4bb8963ba27 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:36.724162 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-33c20f14-19f3-4ed6-9bc9-a4bb8963ba27 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1259 microversion: 2.1 time: 0.162451 Sep 09 23:26:36.724733 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 349/679] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:36 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:36.735712 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-25762a47-b56c-43af-9775-b8ad4a0c0e40 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:36.743552 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-25762a47-b56c-43af-9775-b8ad4a0c0e40 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1242 microversion: 2.1 time: 0.088616 Sep 09 23:26:36.744428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 331/680] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:36 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:37.292342 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-847cee14-56dc-4ad2-b9a0-365beaec9813 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:37.292943 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-847cee14-56dc-4ad2-b9a0-365beaec9813 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:37.300663 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-847cee14-56dc-4ad2-b9a0-365beaec9813 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:37.301149 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-847cee14-56dc-4ad2-b9a0-365beaec9813 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:37.305405 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-847cee14-56dc-4ad2-b9a0-365beaec9813 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:37.305405 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-847cee14-56dc-4ad2-b9a0-365beaec9813 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:37.305405 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-847cee14-56dc-4ad2-b9a0-365beaec9813 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:37.305405 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-847cee14-56dc-4ad2-b9a0-365beaec9813 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:37.438842 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-847cee14-56dc-4ad2-b9a0-365beaec9813 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:37.446896 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-847cee14-56dc-4ad2-b9a0-365beaec9813 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1507 microversion: 2.1 time: 0.158604 Sep 09 23:26:37.447552 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 350/681] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:37 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:37.747313 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1d57888f-19e8-4c1a-a0e2-bbffb5852c22 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:37.747974 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-1d57888f-19e8-4c1a-a0e2-bbffb5852c22 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:37.754565 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d57888f-19e8-4c1a-a0e2-bbffb5852c22 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:37.754999 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d57888f-19e8-4c1a-a0e2-bbffb5852c22 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:37.755438 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d57888f-19e8-4c1a-a0e2-bbffb5852c22 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:37.756173 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d57888f-19e8-4c1a-a0e2-bbffb5852c22 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:37.756633 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d57888f-19e8-4c1a-a0e2-bbffb5852c22 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:37.757062 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d57888f-19e8-4c1a-a0e2-bbffb5852c22 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:37.772317 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0d192e75-3a15-43f1-8f3b-fcb8182408d4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:37.772926 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-0d192e75-3a15-43f1-8f3b-fcb8182408d4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:37.778942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0d192e75-3a15-43f1-8f3b-fcb8182408d4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:37.780107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0d192e75-3a15-43f1-8f3b-fcb8182408d4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:37.780545 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0d192e75-3a15-43f1-8f3b-fcb8182408d4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:37.781232 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0d192e75-3a15-43f1-8f3b-fcb8182408d4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:37.781683 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0d192e75-3a15-43f1-8f3b-fcb8182408d4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:37.782103 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0d192e75-3a15-43f1-8f3b-fcb8182408d4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:37.843696 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-0d192e75-3a15-43f1-8f3b-fcb8182408d4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:37.851774 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-0d192e75-3a15-43f1-8f3b-fcb8182408d4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1242 microversion: 2.1 time: 0.083143 Sep 09 23:26:37.852355 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 351/682] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:37 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:37.982450 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1d57888f-19e8-4c1a-a0e2-bbffb5852c22 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:37.994742 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-1d57888f-19e8-4c1a-a0e2-bbffb5852c22 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1259 microversion: 2.1 time: 0.251174 Sep 09 23:26:37.995276 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 332/683] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:37 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1259 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:38.470946 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7abf15b1-3a00-4adc-adda-1ee65a1afe00 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:38.471557 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7abf15b1-3a00-4adc-adda-1ee65a1afe00 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:38.478840 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7abf15b1-3a00-4adc-adda-1ee65a1afe00 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:38.479656 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7abf15b1-3a00-4adc-adda-1ee65a1afe00 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:38.480264 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7abf15b1-3a00-4adc-adda-1ee65a1afe00 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:38.481129 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7abf15b1-3a00-4adc-adda-1ee65a1afe00 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:38.481754 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7abf15b1-3a00-4adc-adda-1ee65a1afe00 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:38.483469 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7abf15b1-3a00-4adc-adda-1ee65a1afe00 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:38.751667 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7abf15b1-3a00-4adc-adda-1ee65a1afe00 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:38.760731 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7abf15b1-3a00-4adc-adda-1ee65a1afe00 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1507 microversion: 2.1 time: 0.294481 Sep 09 23:26:38.762001 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 352/684] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:38 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1507 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:38.828745 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1516278864", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82394614-0ea4-458c-9c02-f5087a7db4e0"}], "security_groups": [{"name": "tempest-securitygroup--637764649"}], "key_name": "tempest-keypair-1274619386", "user_data": "}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:38.880641 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0ce2809d-7018-4d72-b2cb-6021e100d9f0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:38.881260 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-0ce2809d-7018-4d72-b2cb-6021e100d9f0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:38.888281 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0ce2809d-7018-4d72-b2cb-6021e100d9f0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:38.889595 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0ce2809d-7018-4d72-b2cb-6021e100d9f0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:38.893653 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0ce2809d-7018-4d72-b2cb-6021e100d9f0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:38.893653 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0ce2809d-7018-4d72-b2cb-6021e100d9f0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:38.893653 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0ce2809d-7018-4d72-b2cb-6021e100d9f0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:38.893653 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0ce2809d-7018-4d72-b2cb-6021e100d9f0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:38.950285 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.network.neutron [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] validate_networks() for [('82394614-0ea4-458c-9c02-f5087a7db4e0', None, None, None, None, None)] {{(pid=121058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:26:38.971415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-0ce2809d-7018-4d72-b2cb-6021e100d9f0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:38.992139 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-0ce2809d-7018-4d72-b2cb-6021e100d9f0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1290 microversion: 2.1 time: 0.104466 Sep 09 23:26:38.992139 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 353/685] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:38 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1290 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:39.023906 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7080ddeb-7fcd-494f-a00a-249f8cda8c04 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:39.024891 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7080ddeb-7fcd-494f-a00a-249f8cda8c04 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:39.032543 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7080ddeb-7fcd-494f-a00a-249f8cda8c04 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:39.035458 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7080ddeb-7fcd-494f-a00a-249f8cda8c04 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:39.036073 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7080ddeb-7fcd-494f-a00a-249f8cda8c04 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:39.037026 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7080ddeb-7fcd-494f-a00a-249f8cda8c04 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:39.041889 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7080ddeb-7fcd-494f-a00a-249f8cda8c04 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:39.042743 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7080ddeb-7fcd-494f-a00a-249f8cda8c04 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:39.212940 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7080ddeb-7fcd-494f-a00a-249f8cda8c04 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:39.222294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7080ddeb-7fcd-494f-a00a-249f8cda8c04 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1259 microversion: 2.1 time: 0.206182 Sep 09 23:26:39.222919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 354/686] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:39 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:39.294249 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-8a07f078-e767-4560-be42-9ad0033378e3 req-514e67f3-33dc-44eb-91a0-5d367444ad29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a719e8e5-c9aa-4e96-ba41-eae5881e5b06", "name": "network-vif-deleted", "tag": "2128df64-e397-4a56-8627-d374cf1333e3"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:39.305401 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-8a07f078-e767-4560-be42-9ad0033378e3 req-514e67f3-33dc-44eb-91a0-5d367444ad29 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:39.306018 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-8a07f078-e767-4560-be42-9ad0033378e3 req-514e67f3-33dc-44eb-91a0-5d367444ad29 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:39.306682 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-8a07f078-e767-4560-be42-9ad0033378e3 req-514e67f3-33dc-44eb-91a0-5d367444ad29 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:39.318879 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-8a07f078-e767-4560-be42-9ad0033378e3 req-514e67f3-33dc-44eb-91a0-5d367444ad29 service nova] Creating event network-vif-deleted:2128df64-e397-4a56-8627-d374cf1333e3 for instance a719e8e5-c9aa-4e96-ba41-eae5881e5b06 on hv-cinder-85032 Sep 09 23:26:39.323798 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-8a07f078-e767-4560-be42-9ad0033378e3 req-514e67f3-33dc-44eb-91a0-5d367444ad29 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099466 Sep 09 23:26:39.324400 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 355/687] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:39.789271 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Flavor limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:26:39.792172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-41601367-c86d-4141-a604-c85f6e5a367b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:39.792708 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Image limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:26:39.792913 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-41601367-c86d-4141-a604-c85f6e5a367b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:39.793210 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Flavor pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:26:39.795387 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Image pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:26:39.796610 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:26:39.808177 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:39.808672 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:39.809112 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:39.809843 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:39.810673 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:39.811112 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:39.814840 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-41601367-c86d-4141-a604-c85f6e5a367b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:39.815351 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-41601367-c86d-4141-a604-c85f6e5a367b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:39.815797 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-41601367-c86d-4141-a604-c85f6e5a367b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:39.816518 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-41601367-c86d-4141-a604-c85f6e5a367b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:39.816984 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-41601367-c86d-4141-a604-c85f6e5a367b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:39.817412 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-41601367-c86d-4141-a604-c85f6e5a367b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:39.829579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Getting quotas for project fbe6c3ad574e46fd9d3b37ead0542a18. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:26:39.833886 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Getting quotas for user 27be0979440d4ab081dae31790280eff and project fbe6c3ad574e46fd9d3b37ead0542a18. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:26:39.845707 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Going to run 1 instances... {{(pid=121058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:26:39.848065 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:26:39.851752 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-41601367-c86d-4141-a604-c85f6e5a367b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:39.852245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-41601367-c86d-4141-a604-c85f6e5a367b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:39.852681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-41601367-c86d-4141-a604-c85f6e5a367b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:39.853131 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-41601367-c86d-4141-a604-c85f6e5a367b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lazy-loading 'fault' on Instance uuid a719e8e5-c9aa-4e96-ba41-eae5881e5b06 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:26:39.903599 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-41601367-c86d-4141-a604-c85f6e5a367b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:39.909867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=2 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:39.912589 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-41601367-c86d-4141-a604-c85f6e5a367b tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 200 len: 1312 microversion: 2.1 time: 0.127367 Sep 09 23:26:39.913168 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 356/688] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:39 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 1312 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:40.011972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7d94e751-589d-48bc-b692-483cc6f06091 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:40.012538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7d94e751-589d-48bc-b692-483cc6f06091 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:40.019171 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7d94e751-589d-48bc-b692-483cc6f06091 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:40.019849 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7d94e751-589d-48bc-b692-483cc6f06091 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:40.020286 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7d94e751-589d-48bc-b692-483cc6f06091 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:40.020983 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7d94e751-589d-48bc-b692-483cc6f06091 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:40.021440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7d94e751-589d-48bc-b692-483cc6f06091 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:40.021860 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7d94e751-589d-48bc-b692-483cc6f06091 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:40.025796 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0dcc0346-0df1-461c-9e99-6a213d4377a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.201981 Sep 09 23:26:40.026766 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 333/689] 10.222.0.20 () {62 vars in 1188 bytes} [Fri Sep 9 23:26:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 23:26:40.038369 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4267e82e-41c7-4202-a10a-2eda787bbe87 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:40.039258 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4267e82e-41c7-4202-a10a-2eda787bbe87 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:40.099356 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7d94e751-589d-48bc-b692-483cc6f06091 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:40.114282 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7d94e751-589d-48bc-b692-483cc6f06091 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1296 microversion: 2.1 time: 0.106796 Sep 09 23:26:40.115443 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 357/690] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:40 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1296 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:40.135315 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4267e82e-41c7-4202-a10a-2eda787bbe87 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:40.145471 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4267e82e-41c7-4202-a10a-2eda787bbe87 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:40.147171 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4267e82e-41c7-4202-a10a-2eda787bbe87 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:40.148506 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4267e82e-41c7-4202-a10a-2eda787bbe87 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1282 microversion: 2.20 time: 0.114236 Sep 09 23:26:40.149056 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 334/691] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:40 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1282 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:26:40.250252 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1ff8454e-a5b5-41d9-9738-5caee8edba9b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:40.250911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1ff8454e-a5b5-41d9-9738-5caee8edba9b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:40.256827 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1ff8454e-a5b5-41d9-9738-5caee8edba9b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:40.257314 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1ff8454e-a5b5-41d9-9738-5caee8edba9b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:40.257758 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1ff8454e-a5b5-41d9-9738-5caee8edba9b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:40.258475 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1ff8454e-a5b5-41d9-9738-5caee8edba9b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:40.258931 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1ff8454e-a5b5-41d9-9738-5caee8edba9b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:40.259358 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1ff8454e-a5b5-41d9-9738-5caee8edba9b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:40.496351 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1ff8454e-a5b5-41d9-9738-5caee8edba9b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:40.501011 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:40.506024 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1ff8454e-a5b5-41d9-9738-5caee8edba9b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1259 microversion: 2.1 time: 0.259661 Sep 09 23:26:40.506639 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 358/692] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:40 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1259 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:40.937532 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8722af17-d92b-41cb-913b-bb594d5f1efb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:40.938086 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8722af17-d92b-41cb-913b-bb594d5f1efb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: a719e8e5-c9aa-4e96-ba41-eae5881e5b06] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:40.945175 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8722af17-d92b-41cb-913b-bb594d5f1efb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:40.945697 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8722af17-d92b-41cb-913b-bb594d5f1efb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:40.946171 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8722af17-d92b-41cb-913b-bb594d5f1efb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:40.946929 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8722af17-d92b-41cb-913b-bb594d5f1efb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:40.947382 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8722af17-d92b-41cb-913b-bb594d5f1efb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:40.947805 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8722af17-d92b-41cb-913b-bb594d5f1efb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:40.962554 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-8722af17-d92b-41cb-913b-bb594d5f1efb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] HTTP exception thrown: Instance a719e8e5-c9aa-4e96-ba41-eae5881e5b06 could not be found. Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8722af17-d92b-41cb-913b-bb594d5f1efb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Request method failure captured: Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 HTTP/1.1 Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8pvNjLzJ26L_bDfYD8jco5ncLw5obm7RC4wRKucPyVFopv8LyYjnV_yhQPQAMGp6Zil82MDNt-pAuesw1hNYtsUzcK3dtyAhtCRZHB6fsXyFIBBtemCyksfm8yeHS53wmAq7bbGmXxhGwRUbZisQhpK4e3SQrT2dZnXAXnSUbLamlo Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 57759aec45f74a689727fca5fe201e40 Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-180796804 Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:26:40.964221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:26:40.965824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57759aec45f74a689727fca5fe201e40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57759aec45f74a689727fca5fe201e40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57759aec45f74a689727fca5fe201e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57759aec45f74a689727fca5fe201e40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:26:40.965824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-ServerRescueNegativeTestJSON-180796804 Sep 09 23:26:40.965824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 57759aec45f74a689727fca5fe201e40 Sep 09 23:26:40.965824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-180796804 Sep 09 23:26:40.965824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-ServerRescueNegativeTestJSON-180796804-project Sep 09 23:26:40.965824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:26:40.965824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:26:40.965824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 987d2f6bb1ff4f1fa248c3ff410c8119 Sep 09 23:26:40.965824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-ServerRescueNegativeTestJSON-180796804-project Sep 09 23:26:40.965824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:26:40.965824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance a719e8e5-c9aa-4e96-ba41-eae5881e5b06 could not be found. Sep 09 23:26:40.965824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': 'a719e8e5-c9aa-4e96-ba41-eae5881e5b06'} Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a719e8e5-c9aa-4e96-ba41-eae5881e5b06 could not be found. Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:26:40.968270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a719e8e5-c9aa-4e96-ba41-eae5881e5b06 could not be found. Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a719e8e5-c9aa-4e96-ba41-eae5881e5b06 could not be found. Sep 09 23:26:40.969502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:40.970649 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8722af17-d92b-41cb-913b-bb594d5f1efb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Returning 404 to user: Instance a719e8e5-c9aa-4e96-ba41-eae5881e5b06 could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:26:40.970649 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8722af17-d92b-41cb-913b-bb594d5f1efb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06" status: 404 len: 111 microversion: 2.1 time: 0.033175 Sep 09 23:26:40.970649 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 335/693] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:40 2022] GET /compute/v2.1/servers/a719e8e5-c9aa-4e96-ba41-eae5881e5b06 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:26:40.976017 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-db87e253-44ad-4d9c-a994-2a74aaed7694 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:40.976552 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-db87e253-44ad-4d9c-a994-2a74aaed7694 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:40.983922 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-db87e253-44ad-4d9c-a994-2a74aaed7694 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:40.984413 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-db87e253-44ad-4d9c-a994-2a74aaed7694 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:40.984844 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-db87e253-44ad-4d9c-a994-2a74aaed7694 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:40.985544 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-db87e253-44ad-4d9c-a994-2a74aaed7694 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:40.986117 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-db87e253-44ad-4d9c-a994-2a74aaed7694 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:40.986557 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-db87e253-44ad-4d9c-a994-2a74aaed7694 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:41.013514 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-db87e253-44ad-4d9c-a994-2a74aaed7694 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Going to try to terminate instance {{(pid=121059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:26:41.139315 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-514d14b5-fb7f-457b-baa0-69831525cfe9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:41.140185 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-514d14b5-fb7f-457b-baa0-69831525cfe9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:41.150160 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:41.151808 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-514d14b5-fb7f-457b-baa0-69831525cfe9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:41.152482 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-514d14b5-fb7f-457b-baa0-69831525cfe9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:41.152923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-514d14b5-fb7f-457b-baa0-69831525cfe9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:41.153626 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-514d14b5-fb7f-457b-baa0-69831525cfe9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:41.154933 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-514d14b5-fb7f-457b-baa0-69831525cfe9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:41.163988 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-514d14b5-fb7f-457b-baa0-69831525cfe9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:41.291852 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-db87e253-44ad-4d9c-a994-2a74aaed7694 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 204 len: 0 microversion: 2.1 time: 0.320616 Sep 09 23:26:41.293295 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 359/694] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:26:40 2022] DELETE /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:26:41.299527 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8d618f06-028b-4b49-8ea6-142ff0da1d3b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:41.300470 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8d618f06-028b-4b49-8ea6-142ff0da1d3b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:41.306550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d618f06-028b-4b49-8ea6-142ff0da1d3b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:41.307042 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d618f06-028b-4b49-8ea6-142ff0da1d3b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:41.307483 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d618f06-028b-4b49-8ea6-142ff0da1d3b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:41.308186 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d618f06-028b-4b49-8ea6-142ff0da1d3b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:41.308644 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d618f06-028b-4b49-8ea6-142ff0da1d3b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:41.309217 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d618f06-028b-4b49-8ea6-142ff0da1d3b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:41.337063 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-514d14b5-fb7f-457b-baa0-69831525cfe9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:41.345471 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-514d14b5-fb7f-457b-baa0-69831525cfe9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1363 microversion: 2.1 time: 0.210263 Sep 09 23:26:41.346048 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 336/695] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:41 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:41.350522 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a44afe96-c2fc-43fd-afec-c738c9adcaf8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:41.351139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a44afe96-c2fc-43fd-afec-c738c9adcaf8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:41.357770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a44afe96-c2fc-43fd-afec-c738c9adcaf8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:41.358476 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a44afe96-c2fc-43fd-afec-c738c9adcaf8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:41.359185 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a44afe96-c2fc-43fd-afec-c738c9adcaf8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:41.359886 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a44afe96-c2fc-43fd-afec-c738c9adcaf8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:41.360611 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a44afe96-c2fc-43fd-afec-c738c9adcaf8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:41.361340 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a44afe96-c2fc-43fd-afec-c738c9adcaf8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:41.395732 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8d618f06-028b-4b49-8ea6-142ff0da1d3b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:41.397190 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8d618f06-028b-4b49-8ea6-142ff0da1d3b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:41.398655 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8d618f06-028b-4b49-8ea6-142ff0da1d3b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:41.399765 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8d618f06-028b-4b49-8ea6-142ff0da1d3b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1286 microversion: 2.20 time: 0.105838 Sep 09 23:26:41.400343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 360/696] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:41 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:41.507713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a44afe96-c2fc-43fd-afec-c738c9adcaf8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:41.516300 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a44afe96-c2fc-43fd-afec-c738c9adcaf8 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.169216 Sep 09 23:26:41.516880 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 337/697] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:41 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:41.534728 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1f47f491-c0d2-462d-a56e-e7ab956013b8 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:41.535382 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1f47f491-c0d2-462d-a56e-e7ab956013b8 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:41.546887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1f47f491-c0d2-462d-a56e-e7ab956013b8 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:41.547980 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1f47f491-c0d2-462d-a56e-e7ab956013b8 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:41.548672 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1f47f491-c0d2-462d-a56e-e7ab956013b8 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:41.549922 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1f47f491-c0d2-462d-a56e-e7ab956013b8 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:41.550637 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1f47f491-c0d2-462d-a56e-e7ab956013b8 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:41.551424 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1f47f491-c0d2-462d-a56e-e7ab956013b8 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:41.744181 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1f47f491-c0d2-462d-a56e-e7ab956013b8 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:41.752445 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1f47f491-c0d2-462d-a56e-e7ab956013b8 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1259 microversion: 2.1 time: 0.226857 Sep 09 23:26:41.753001 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 361/698] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:41 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:41.949947 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-c2195baa-d1ea-4891-a4bc-65793561652c req-5a5cde65-0ee3-4421-9b86-af71d7f956ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "026e4485-df9d-411d-98da-db2109bcf03b", "tag": "0780d6cc-ab17-42a7-894c-8eff61ba4eab"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:41.960868 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c2195baa-d1ea-4891-a4bc-65793561652c req-5a5cde65-0ee3-4421-9b86-af71d7f956ba service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:41.961346 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c2195baa-d1ea-4891-a4bc-65793561652c req-5a5cde65-0ee3-4421-9b86-af71d7f956ba service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:41.961783 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c2195baa-d1ea-4891-a4bc-65793561652c req-5a5cde65-0ee3-4421-9b86-af71d7f956ba service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:41.973175 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-c2195baa-d1ea-4891-a4bc-65793561652c req-5a5cde65-0ee3-4421-9b86-af71d7f956ba service nova] Creating event network-changed:0780d6cc-ab17-42a7-894c-8eff61ba4eab for instance 026e4485-df9d-411d-98da-db2109bcf03b on hv-cinder-85032 Sep 09 23:26:41.977866 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-c2195baa-d1ea-4891-a4bc-65793561652c req-5a5cde65-0ee3-4421-9b86-af71d7f956ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031918 Sep 09 23:26:41.978484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 338/699] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:26:42.369007 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1958f45e-e417-423a-959e-38eb184e0a6c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:42.369620 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1958f45e-e417-423a-959e-38eb184e0a6c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:42.377241 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1958f45e-e417-423a-959e-38eb184e0a6c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:42.377722 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1958f45e-e417-423a-959e-38eb184e0a6c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:42.378157 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1958f45e-e417-423a-959e-38eb184e0a6c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:42.378878 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1958f45e-e417-423a-959e-38eb184e0a6c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:42.379340 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1958f45e-e417-423a-959e-38eb184e0a6c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:42.379765 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1958f45e-e417-423a-959e-38eb184e0a6c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:42.428676 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4f9151b0-0af2-44df-ace4-df2a30e28b71 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:42.429468 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4f9151b0-0af2-44df-ace4-df2a30e28b71 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:42.435908 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4f9151b0-0af2-44df-ace4-df2a30e28b71 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:42.436392 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4f9151b0-0af2-44df-ace4-df2a30e28b71 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:42.437482 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4f9151b0-0af2-44df-ace4-df2a30e28b71 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:42.438189 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4f9151b0-0af2-44df-ace4-df2a30e28b71 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:42.438685 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4f9151b0-0af2-44df-ace4-df2a30e28b71 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:42.439114 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4f9151b0-0af2-44df-ace4-df2a30e28b71 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:42.504561 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4f9151b0-0af2-44df-ace4-df2a30e28b71 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:42.513112 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4f9151b0-0af2-44df-ace4-df2a30e28b71 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:42.514688 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4f9151b0-0af2-44df-ace4-df2a30e28b71 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:42.515553 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-1958f45e-e417-423a-959e-38eb184e0a6c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:42.515836 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4f9151b0-0af2-44df-ace4-df2a30e28b71 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1334 microversion: 2.20 time: 0.094623 Sep 09 23:26:42.516439 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 339/700] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:42 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1334 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:26:42.524094 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1958f45e-e417-423a-959e-38eb184e0a6c tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1363 microversion: 2.1 time: 0.158906 Sep 09 23:26:42.524690 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 362/701] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:42 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:42.539409 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4584eaa2-c958-44a3-aab7-1b2bcf83f3cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:42.539998 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4584eaa2-c958-44a3-aab7-1b2bcf83f3cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:42.546396 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4584eaa2-c958-44a3-aab7-1b2bcf83f3cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:42.546884 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4584eaa2-c958-44a3-aab7-1b2bcf83f3cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:42.547310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4584eaa2-c958-44a3-aab7-1b2bcf83f3cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:42.547987 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4584eaa2-c958-44a3-aab7-1b2bcf83f3cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:42.548437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4584eaa2-c958-44a3-aab7-1b2bcf83f3cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:42.548854 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4584eaa2-c958-44a3-aab7-1b2bcf83f3cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:42.566684 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:42.680428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4584eaa2-c958-44a3-aab7-1b2bcf83f3cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:42.688014 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4584eaa2-c958-44a3-aab7-1b2bcf83f3cb tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.152443 Sep 09 23:26:42.688589 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 340/702] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:42 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:42.774850 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b7eda8c2-f03f-4c88-8d5a-4177b6321c52 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:42.775464 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b7eda8c2-f03f-4c88-8d5a-4177b6321c52 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:42.782202 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b7eda8c2-f03f-4c88-8d5a-4177b6321c52 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:42.783102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b7eda8c2-f03f-4c88-8d5a-4177b6321c52 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:42.783676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b7eda8c2-f03f-4c88-8d5a-4177b6321c52 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:42.784380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b7eda8c2-f03f-4c88-8d5a-4177b6321c52 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:42.784839 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b7eda8c2-f03f-4c88-8d5a-4177b6321c52 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:42.785311 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b7eda8c2-f03f-4c88-8d5a-4177b6321c52 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:42.912189 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b7eda8c2-f03f-4c88-8d5a-4177b6321c52 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:42.919767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b7eda8c2-f03f-4c88-8d5a-4177b6321c52 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1259 microversion: 2.1 time: 0.148945 Sep 09 23:26:42.920329 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 363/703] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:42 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:43.543330 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-01ad86b3-ee82-4159-9133-cafd4894e136 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:43.543912 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-01ad86b3-ee82-4159-9133-cafd4894e136 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:43.548715 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-2b9f39f2-edec-40f2-8e2a-117f5623699e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:43.549439 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-2b9f39f2-edec-40f2-8e2a-117f5623699e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:43.554578 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01ad86b3-ee82-4159-9133-cafd4894e136 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:43.555061 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01ad86b3-ee82-4159-9133-cafd4894e136 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:43.555215 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b9f39f2-edec-40f2-8e2a-117f5623699e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:43.555556 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01ad86b3-ee82-4159-9133-cafd4894e136 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:43.555672 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b9f39f2-edec-40f2-8e2a-117f5623699e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:43.556105 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b9f39f2-edec-40f2-8e2a-117f5623699e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:43.556785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b9f39f2-edec-40f2-8e2a-117f5623699e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:43.556916 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01ad86b3-ee82-4159-9133-cafd4894e136 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:43.557233 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b9f39f2-edec-40f2-8e2a-117f5623699e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:43.557383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01ad86b3-ee82-4159-9133-cafd4894e136 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:43.557652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b9f39f2-edec-40f2-8e2a-117f5623699e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:43.557814 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01ad86b3-ee82-4159-9133-cafd4894e136 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:43.618765 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-01ad86b3-ee82-4159-9133-cafd4894e136 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:43.627028 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-01ad86b3-ee82-4159-9133-cafd4894e136 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:43.628479 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-01ad86b3-ee82-4159-9133-cafd4894e136 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:43.629589 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-01ad86b3-ee82-4159-9133-cafd4894e136 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1334 microversion: 2.20 time: 0.090652 Sep 09 23:26:43.630156 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 341/704] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:43 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1334 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:43.688975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-2b9f39f2-edec-40f2-8e2a-117f5623699e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:43.696565 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-2b9f39f2-edec-40f2-8e2a-117f5623699e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1363 microversion: 2.1 time: 0.153541 Sep 09 23:26:43.697128 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 364/705] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:43 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:43.711127 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-427139b4-4274-427a-81ac-87ea6b1c1a04 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:43.711767 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-427139b4-4274-427a-81ac-87ea6b1c1a04 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:43.718197 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-427139b4-4274-427a-81ac-87ea6b1c1a04 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:43.718836 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-427139b4-4274-427a-81ac-87ea6b1c1a04 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:43.719269 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-427139b4-4274-427a-81ac-87ea6b1c1a04 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:43.719951 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-427139b4-4274-427a-81ac-87ea6b1c1a04 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:43.720402 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-427139b4-4274-427a-81ac-87ea6b1c1a04 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:43.720825 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-427139b4-4274-427a-81ac-87ea6b1c1a04 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:43.850408 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-427139b4-4274-427a-81ac-87ea6b1c1a04 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:43.858269 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-427139b4-4274-427a-81ac-87ea6b1c1a04 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.150859 Sep 09 23:26:43.874726 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 342/706] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:43 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:43.942700 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c0e03891-462f-4db1-b805-b4712219b693 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:43.943306 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-c0e03891-462f-4db1-b805-b4712219b693 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:43.949225 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c0e03891-462f-4db1-b805-b4712219b693 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:43.949716 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c0e03891-462f-4db1-b805-b4712219b693 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:43.950136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c0e03891-462f-4db1-b805-b4712219b693 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:43.950845 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c0e03891-462f-4db1-b805-b4712219b693 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:43.951296 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c0e03891-462f-4db1-b805-b4712219b693 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:43.951714 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c0e03891-462f-4db1-b805-b4712219b693 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:44.081482 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-c0e03891-462f-4db1-b805-b4712219b693 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:44.089058 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-c0e03891-462f-4db1-b805-b4712219b693 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1259 microversion: 2.1 time: 0.150156 Sep 09 23:26:44.089621 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 365/707] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:43 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:44.659238 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-59e9da93-2aa9-47a3-959c-3499875e4128 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:44.661548 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-59e9da93-2aa9-47a3-959c-3499875e4128 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:44.669992 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-59e9da93-2aa9-47a3-959c-3499875e4128 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:44.671396 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-59e9da93-2aa9-47a3-959c-3499875e4128 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:44.672006 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-59e9da93-2aa9-47a3-959c-3499875e4128 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:44.672905 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-59e9da93-2aa9-47a3-959c-3499875e4128 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:44.673751 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-59e9da93-2aa9-47a3-959c-3499875e4128 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:44.674502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-59e9da93-2aa9-47a3-959c-3499875e4128 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:44.722202 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-dbb6f6d1-366c-4318-8c48-d2fe957df858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:44.723883 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-dbb6f6d1-366c-4318-8c48-d2fe957df858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:44.732968 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dbb6f6d1-366c-4318-8c48-d2fe957df858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:44.734577 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dbb6f6d1-366c-4318-8c48-d2fe957df858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:44.735565 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dbb6f6d1-366c-4318-8c48-d2fe957df858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:44.736629 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dbb6f6d1-366c-4318-8c48-d2fe957df858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:44.737529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dbb6f6d1-366c-4318-8c48-d2fe957df858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:44.738047 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-dbb6f6d1-366c-4318-8c48-d2fe957df858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:44.778622 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-59e9da93-2aa9-47a3-959c-3499875e4128 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:44.788507 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-59e9da93-2aa9-47a3-959c-3499875e4128 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:44.790197 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-59e9da93-2aa9-47a3-959c-3499875e4128 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:44.791546 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-59e9da93-2aa9-47a3-959c-3499875e4128 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1334 microversion: 2.20 time: 0.139924 Sep 09 23:26:44.792259 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 343/708] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:44 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1334 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:44.878508 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-dbb6f6d1-366c-4318-8c48-d2fe957df858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:44.882021 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b1713b99-a222-4bf6-a545-a1bf863130b1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:44.882689 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b1713b99-a222-4bf6-a545-a1bf863130b1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:44.886800 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-dbb6f6d1-366c-4318-8c48-d2fe957df858 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1363 microversion: 2.1 time: 0.170452 Sep 09 23:26:44.888203 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 366/709] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:44 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:44.888543 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1713b99-a222-4bf6-a545-a1bf863130b1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:44.889032 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1713b99-a222-4bf6-a545-a1bf863130b1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:44.890109 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1713b99-a222-4bf6-a545-a1bf863130b1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:44.891505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1713b99-a222-4bf6-a545-a1bf863130b1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:44.892039 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1713b99-a222-4bf6-a545-a1bf863130b1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:44.892477 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b1713b99-a222-4bf6-a545-a1bf863130b1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:45.115290 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b1713b99-a222-4bf6-a545-a1bf863130b1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:45.121283 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-91e1f6fa-859e-45c7-8af3-1a7db5013d62 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:45.121903 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-91e1f6fa-859e-45c7-8af3-1a7db5013d62 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:45.124568 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b1713b99-a222-4bf6-a545-a1bf863130b1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1521 microversion: 2.1 time: 0.246328 Sep 09 23:26:45.134535 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:45.134702 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 344/710] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:44 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:45.134808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-91e1f6fa-859e-45c7-8af3-1a7db5013d62 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:45.134808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-91e1f6fa-859e-45c7-8af3-1a7db5013d62 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:45.134808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-91e1f6fa-859e-45c7-8af3-1a7db5013d62 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:45.134808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-91e1f6fa-859e-45c7-8af3-1a7db5013d62 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:45.135090 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-91e1f6fa-859e-45c7-8af3-1a7db5013d62 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:45.135090 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-91e1f6fa-859e-45c7-8af3-1a7db5013d62 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:45.138451 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b97b1a2d-db1e-47e2-95c9-41ef02a703f7 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:45.141154 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b97b1a2d-db1e-47e2-95c9-41ef02a703f7 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:45.155034 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b97b1a2d-db1e-47e2-95c9-41ef02a703f7 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:45.155937 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b97b1a2d-db1e-47e2-95c9-41ef02a703f7 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:45.156805 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b97b1a2d-db1e-47e2-95c9-41ef02a703f7 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:45.157678 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b97b1a2d-db1e-47e2-95c9-41ef02a703f7 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:45.166551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b97b1a2d-db1e-47e2-95c9-41ef02a703f7 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:45.166551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b97b1a2d-db1e-47e2-95c9-41ef02a703f7 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:45.379499 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-91e1f6fa-859e-45c7-8af3-1a7db5013d62 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:45.394138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-91e1f6fa-859e-45c7-8af3-1a7db5013d62 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1259 microversion: 2.1 time: 0.273222 Sep 09 23:26:45.396061 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 367/711] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:45 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1259 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:45.479470 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-428c267a-6ab4-40b5-8aad-e99f4a8d84ac req-66f1554b-bc36-4a0f-8877-82d55471c834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b8a715-050b-4cbd-aff9-747f65d1e8b5", "name": "network-vif-deleted", "tag": "9a2bd38a-1f80-486d-8e11-48bf4e66c96d"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:45.489777 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-428c267a-6ab4-40b5-8aad-e99f4a8d84ac req-66f1554b-bc36-4a0f-8877-82d55471c834 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:45.490453 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-428c267a-6ab4-40b5-8aad-e99f4a8d84ac req-66f1554b-bc36-4a0f-8877-82d55471c834 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:45.490888 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-428c267a-6ab4-40b5-8aad-e99f4a8d84ac req-66f1554b-bc36-4a0f-8877-82d55471c834 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:45.503694 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-428c267a-6ab4-40b5-8aad-e99f4a8d84ac req-66f1554b-bc36-4a0f-8877-82d55471c834 service nova] Creating event network-vif-deleted:9a2bd38a-1f80-486d-8e11-48bf4e66c96d for instance e2b8a715-050b-4cbd-aff9-747f65d1e8b5 on hv-cinder-85032 Sep 09 23:26:45.505234 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b97b1a2d-db1e-47e2-95c9-41ef02a703f7 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:45.508692 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-428c267a-6ab4-40b5-8aad-e99f4a8d84ac req-66f1554b-bc36-4a0f-8877-82d55471c834 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032963 Sep 09 23:26:45.509292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 368/712] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:26:45.516910 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b97b1a2d-db1e-47e2-95c9-41ef02a703f7 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1593 microversion: 2.1 time: 0.388350 Sep 09 23:26:45.518330 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 345/713] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:45 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1593 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:45.818746 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b6fe6ee1-fa71-4b6e-a924-8d5d32c362c8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:45.820113 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b6fe6ee1-fa71-4b6e-a924-8d5d32c362c8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:45.827647 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b6fe6ee1-fa71-4b6e-a924-8d5d32c362c8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:45.828404 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b6fe6ee1-fa71-4b6e-a924-8d5d32c362c8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:45.828850 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b6fe6ee1-fa71-4b6e-a924-8d5d32c362c8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:45.829814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b6fe6ee1-fa71-4b6e-a924-8d5d32c362c8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:45.830280 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b6fe6ee1-fa71-4b6e-a924-8d5d32c362c8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:45.830748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b6fe6ee1-fa71-4b6e-a924-8d5d32c362c8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:45.901388 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b6fe6ee1-fa71-4b6e-a924-8d5d32c362c8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:45.910101 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b6fe6ee1-fa71-4b6e-a924-8d5d32c362c8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:45.910995 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-00a24e6e-6f97-480f-a6e8-668d8edcd486 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:45.911835 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-00a24e6e-6f97-480f-a6e8-668d8edcd486 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:45.911952 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b6fe6ee1-fa71-4b6e-a924-8d5d32c362c8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:45.915888 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b6fe6ee1-fa71-4b6e-a924-8d5d32c362c8 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1340 microversion: 2.20 time: 0.099519 Sep 09 23:26:45.918708 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-00a24e6e-6f97-480f-a6e8-668d8edcd486 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:45.919302 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-00a24e6e-6f97-480f-a6e8-668d8edcd486 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:45.919842 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-00a24e6e-6f97-480f-a6e8-668d8edcd486 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:45.920760 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-00a24e6e-6f97-480f-a6e8-668d8edcd486 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:45.921704 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-00a24e6e-6f97-480f-a6e8-668d8edcd486 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:45.922278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-00a24e6e-6f97-480f-a6e8-668d8edcd486 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:45.931342 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 369/714] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:45 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1340 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:46.148581 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-00a24e6e-6f97-480f-a6e8-668d8edcd486 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:46.159984 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f0ee7eff-faa8-4d4c-9bf0-1c6be12ce4c9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:46.160919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f0ee7eff-faa8-4d4c-9bf0-1c6be12ce4c9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:46.175360 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f0ee7eff-faa8-4d4c-9bf0-1c6be12ce4c9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:46.178895 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f0ee7eff-faa8-4d4c-9bf0-1c6be12ce4c9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:46.179070 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-00a24e6e-6f97-480f-a6e8-668d8edcd486 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1363 microversion: 2.1 time: 0.271970 Sep 09 23:26:46.179590 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f0ee7eff-faa8-4d4c-9bf0-1c6be12ce4c9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:46.180722 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f0ee7eff-faa8-4d4c-9bf0-1c6be12ce4c9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:46.181566 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f0ee7eff-faa8-4d4c-9bf0-1c6be12ce4c9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:46.182013 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f0ee7eff-faa8-4d4c-9bf0-1c6be12ce4c9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:46.190829 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 346/715] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:45 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:46.257752 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=12 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:46.261416 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f0ee7eff-faa8-4d4c-9bf0-1c6be12ce4c9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:46.269480 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f0ee7eff-faa8-4d4c-9bf0-1c6be12ce4c9 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1307 microversion: 2.1 time: 0.114868 Sep 09 23:26:46.270149 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 370/716] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:46 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1307 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:46.418886 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3114351e-b0ac-45ad-a491-734dd0d6b572 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:46.419582 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3114351e-b0ac-45ad-a491-734dd0d6b572 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:46.427231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3114351e-b0ac-45ad-a491-734dd0d6b572 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:46.427864 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3114351e-b0ac-45ad-a491-734dd0d6b572 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:46.428306 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3114351e-b0ac-45ad-a491-734dd0d6b572 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:46.429239 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3114351e-b0ac-45ad-a491-734dd0d6b572 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:46.429727 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3114351e-b0ac-45ad-a491-734dd0d6b572 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:46.430187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3114351e-b0ac-45ad-a491-734dd0d6b572 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:46.574078 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3114351e-b0ac-45ad-a491-734dd0d6b572 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:46.587088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3114351e-b0ac-45ad-a491-734dd0d6b572 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1259 microversion: 2.1 time: 0.171739 Sep 09 23:26:46.588134 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 347/717] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:46 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:46.942434 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e16ffae6-c241-4360-991d-7fa6e73dd4b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:46.946636 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e16ffae6-c241-4360-991d-7fa6e73dd4b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:46.953460 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e16ffae6-c241-4360-991d-7fa6e73dd4b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:46.954566 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e16ffae6-c241-4360-991d-7fa6e73dd4b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:46.955218 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e16ffae6-c241-4360-991d-7fa6e73dd4b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:46.956134 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e16ffae6-c241-4360-991d-7fa6e73dd4b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:46.956795 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e16ffae6-c241-4360-991d-7fa6e73dd4b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:46.957432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e16ffae6-c241-4360-991d-7fa6e73dd4b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:47.028030 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e16ffae6-c241-4360-991d-7fa6e73dd4b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:47.037021 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e16ffae6-c241-4360-991d-7fa6e73dd4b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:47.038513 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e16ffae6-c241-4360-991d-7fa6e73dd4b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:47.039590 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e16ffae6-c241-4360-991d-7fa6e73dd4b0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1340 microversion: 2.20 time: 0.103255 Sep 09 23:26:47.040151 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 371/718] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:46 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1340 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:47.205897 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3028f17e-c159-4ab6-9546-76029f5bbe0f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:47.206719 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3028f17e-c159-4ab6-9546-76029f5bbe0f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:47.213291 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3028f17e-c159-4ab6-9546-76029f5bbe0f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:47.213895 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3028f17e-c159-4ab6-9546-76029f5bbe0f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:47.214464 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3028f17e-c159-4ab6-9546-76029f5bbe0f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:47.215264 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3028f17e-c159-4ab6-9546-76029f5bbe0f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:47.215967 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3028f17e-c159-4ab6-9546-76029f5bbe0f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:47.216488 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3028f17e-c159-4ab6-9546-76029f5bbe0f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:47.299349 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e2c61b5a-a9ef-4885-8906-35bec5bfe629 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:47.301117 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e2c61b5a-a9ef-4885-8906-35bec5bfe629 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:47.308884 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e2c61b5a-a9ef-4885-8906-35bec5bfe629 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:47.312217 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e2c61b5a-a9ef-4885-8906-35bec5bfe629 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:47.312217 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e2c61b5a-a9ef-4885-8906-35bec5bfe629 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:47.312217 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e2c61b5a-a9ef-4885-8906-35bec5bfe629 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:47.312769 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e2c61b5a-a9ef-4885-8906-35bec5bfe629 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:47.313358 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e2c61b5a-a9ef-4885-8906-35bec5bfe629 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:47.347877 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e2c61b5a-a9ef-4885-8906-35bec5bfe629 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:47.348632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e2c61b5a-a9ef-4885-8906-35bec5bfe629 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:47.349074 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e2c61b5a-a9ef-4885-8906-35bec5bfe629 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:47.349522 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-e2c61b5a-a9ef-4885-8906-35bec5bfe629 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lazy-loading 'fault' on Instance uuid e2b8a715-050b-4cbd-aff9-747f65d1e8b5 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:26:47.401903 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e2c61b5a-a9ef-4885-8906-35bec5bfe629 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987d2f6bb1ff4f1fa248c3ff410c8119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57759aec45f74a689727fca5fe201e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:47.411231 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e2c61b5a-a9ef-4885-8906-35bec5bfe629 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 200 len: 1312 microversion: 2.1 time: 0.117780 Sep 09 23:26:47.412273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 372/719] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:47 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 1312 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:47.527212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3028f17e-c159-4ab6-9546-76029f5bbe0f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:47.535350 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3028f17e-c159-4ab6-9546-76029f5bbe0f tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1363 microversion: 2.1 time: 0.333880 Sep 09 23:26:47.536184 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 348/720] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:47 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1363 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:47.612577 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-883ca04f-1e00-48be-b550-caefc6dce2ba tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:47.613191 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-883ca04f-1e00-48be-b550-caefc6dce2ba tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:47.619060 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-883ca04f-1e00-48be-b550-caefc6dce2ba tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:47.619542 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-883ca04f-1e00-48be-b550-caefc6dce2ba tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:47.621038 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-883ca04f-1e00-48be-b550-caefc6dce2ba tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:47.621803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-883ca04f-1e00-48be-b550-caefc6dce2ba tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:47.622289 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-883ca04f-1e00-48be-b550-caefc6dce2ba tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:47.622735 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-883ca04f-1e00-48be-b550-caefc6dce2ba tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:47.771955 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-883ca04f-1e00-48be-b550-caefc6dce2ba tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:47.783798 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-883ca04f-1e00-48be-b550-caefc6dce2ba tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1259 microversion: 2.1 time: 0.172363 Sep 09 23:26:47.783798 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 373/721] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:47 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:48.066422 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-010bd6e2-849a-40aa-82c8-de722d10a29b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:48.067048 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-010bd6e2-849a-40aa-82c8-de722d10a29b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:48.078564 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-010bd6e2-849a-40aa-82c8-de722d10a29b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:48.079056 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-010bd6e2-849a-40aa-82c8-de722d10a29b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:48.079507 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-010bd6e2-849a-40aa-82c8-de722d10a29b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:48.080229 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-010bd6e2-849a-40aa-82c8-de722d10a29b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:48.080695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-010bd6e2-849a-40aa-82c8-de722d10a29b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:48.081133 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-010bd6e2-849a-40aa-82c8-de722d10a29b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:48.435038 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4aeeaaad-9042-4f49-9b7c-c514a333fcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:48.435748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4aeeaaad-9042-4f49-9b7c-c514a333fcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] [instance: e2b8a715-050b-4cbd-aff9-747f65d1e8b5] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:48.442985 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4aeeaaad-9042-4f49-9b7c-c514a333fcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:48.443570 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4aeeaaad-9042-4f49-9b7c-c514a333fcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:48.444109 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4aeeaaad-9042-4f49-9b7c-c514a333fcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:48.444888 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4aeeaaad-9042-4f49-9b7c-c514a333fcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:48.445460 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4aeeaaad-9042-4f49-9b7c-c514a333fcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:48.445901 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4aeeaaad-9042-4f49-9b7c-c514a333fcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:48.450519 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:48.461690 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-4aeeaaad-9042-4f49-9b7c-c514a333fcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] HTTP exception thrown: Instance e2b8a715-050b-4cbd-aff9-747f65d1e8b5 could not be found. Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4aeeaaad-9042-4f49-9b7c-c514a333fcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Request method failure captured: Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 HTTP/1.1 Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8pvNjLzJ26L_bDfYD8jco5ncLw5obm7RC4wRKucPyVFopv8LyYjnV_yhQPQAMGp6Zil82MDNt-pAuesw1hNYtsUzcK3dtyAhtCRZHB6fsXyFIBBtemCyksfm8yeHS53wmAq7bbGmXxhGwRUbZisQhpK4e3SQrT2dZnXAXnSUbLamlo Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 57759aec45f74a689727fca5fe201e40 Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-180796804 Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:26:48.463626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:26:48.465248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57759aec45f74a689727fca5fe201e40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57759aec45f74a689727fca5fe201e40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57759aec45f74a689727fca5fe201e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57759aec45f74a689727fca5fe201e40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:26:48.465248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-ServerRescueNegativeTestJSON-180796804 Sep 09 23:26:48.465248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 57759aec45f74a689727fca5fe201e40 Sep 09 23:26:48.465248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-180796804 Sep 09 23:26:48.465248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-ServerRescueNegativeTestJSON-180796804-project Sep 09 23:26:48.465248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:26:48.465248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:26:48.465248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 987d2f6bb1ff4f1fa248c3ff410c8119 Sep 09 23:26:48.465248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-ServerRescueNegativeTestJSON-180796804-project Sep 09 23:26:48.465248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:26:48.465248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance e2b8a715-050b-4cbd-aff9-747f65d1e8b5 could not be found. Sep 09 23:26:48.465248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': 'e2b8a715-050b-4cbd-aff9-747f65d1e8b5'} Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b8a715-050b-4cbd-aff9-747f65d1e8b5 could not be found. Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:26:48.466538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b8a715-050b-4cbd-aff9-747f65d1e8b5 could not be found. Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b8a715-050b-4cbd-aff9-747f65d1e8b5 could not be found. Sep 09 23:26:48.468841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:48.470186 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4aeeaaad-9042-4f49-9b7c-c514a333fcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] Returning 404 to user: Instance e2b8a715-050b-4cbd-aff9-747f65d1e8b5 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:26:48.470186 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4aeeaaad-9042-4f49-9b7c-c514a333fcc1 tempest-ServerRescueNegativeTestJSON-180796804 tempest-ServerRescueNegativeTestJSON-180796804-project] 10.222.0.20 "GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5" status: 404 len: 111 microversion: 2.1 time: 0.034165 Sep 09 23:26:48.470186 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 374/722] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:48 2022] GET /compute/v2.1/servers/e2b8a715-050b-4cbd-aff9-747f65d1e8b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:26:48.559174 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d3ed482e-806b-4798-8685-09f4eeb348f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:48.559833 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d3ed482e-806b-4798-8685-09f4eeb348f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:48.580814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d3ed482e-806b-4798-8685-09f4eeb348f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:48.580814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d3ed482e-806b-4798-8685-09f4eeb348f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:48.581104 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d3ed482e-806b-4798-8685-09f4eeb348f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:48.581817 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d3ed482e-806b-4798-8685-09f4eeb348f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:48.582277 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d3ed482e-806b-4798-8685-09f4eeb348f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:48.582755 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d3ed482e-806b-4798-8685-09f4eeb348f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:48.672295 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-010bd6e2-849a-40aa-82c8-de722d10a29b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:48.683474 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-010bd6e2-849a-40aa-82c8-de722d10a29b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:48.685885 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-010bd6e2-849a-40aa-82c8-de722d10a29b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:48.688041 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-010bd6e2-849a-40aa-82c8-de722d10a29b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1407 microversion: 2.20 time: 0.625518 Sep 09 23:26:48.695077 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 349/723] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:48 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1407 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:48.805918 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-cb5456ba-dba5-4341-8cc0-d66bf679bbd3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:48.806828 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-cb5456ba-dba5-4341-8cc0-d66bf679bbd3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:48.813150 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cb5456ba-dba5-4341-8cc0-d66bf679bbd3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:48.813865 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cb5456ba-dba5-4341-8cc0-d66bf679bbd3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:48.814667 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cb5456ba-dba5-4341-8cc0-d66bf679bbd3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:48.815553 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cb5456ba-dba5-4341-8cc0-d66bf679bbd3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:48.816174 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cb5456ba-dba5-4341-8cc0-d66bf679bbd3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:48.816783 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cb5456ba-dba5-4341-8cc0-d66bf679bbd3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:48.865373 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d3ed482e-806b-4798-8685-09f4eeb348f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:48.875472 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d3ed482e-806b-4798-8685-09f4eeb348f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1363 microversion: 2.1 time: 0.320620 Sep 09 23:26:48.876654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 375/724] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:48 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:49.005014 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-6f45f7ce-1ec9-42d6-876b-86bd011dee1d req-b1493041-2eba-4f02-863a-7fa86d24934e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d367ef-58a3-46c5-94d6-8723e6cca32b", "name": "network-vif-plugged", "status": "completed", "tag": "c92b2495-b9d4-4026-960c-2b98f517147e"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:49.018810 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-6f45f7ce-1ec9-42d6-876b-86bd011dee1d req-b1493041-2eba-4f02-863a-7fa86d24934e service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:49.019811 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-6f45f7ce-1ec9-42d6-876b-86bd011dee1d req-b1493041-2eba-4f02-863a-7fa86d24934e service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:49.020522 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-6f45f7ce-1ec9-42d6-876b-86bd011dee1d req-b1493041-2eba-4f02-863a-7fa86d24934e service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:49.038109 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-6f45f7ce-1ec9-42d6-876b-86bd011dee1d req-b1493041-2eba-4f02-863a-7fa86d24934e service nova] Creating event network-vif-plugged:c92b2495-b9d4-4026-960c-2b98f517147e for instance 77d367ef-58a3-46c5-94d6-8723e6cca32b on hv-cinder-85032 Sep 09 23:26:49.045260 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-6f45f7ce-1ec9-42d6-876b-86bd011dee1d req-b1493041-2eba-4f02-863a-7fa86d24934e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127590 Sep 09 23:26:49.046548 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 376/725] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:49.164346 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-cb5456ba-dba5-4341-8cc0-d66bf679bbd3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:49.175242 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-cb5456ba-dba5-4341-8cc0-d66bf679bbd3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1259 microversion: 2.1 time: 0.373834 Sep 09 23:26:49.180626 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 350/726] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:48 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1259 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:49.545178 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-bce8fde9-7b11-4f07-a61d-4c699cdb82c3 req-8fa08085-2b3f-45a0-90d7-80809aac5c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072aebfe-bdb3-47e7-9b55-deddc8c248e9", "tag": "d8801e29-936f-4850-b8b8-729b8370c4bc"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:49.557974 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-bce8fde9-7b11-4f07-a61d-4c699cdb82c3 req-8fa08085-2b3f-45a0-90d7-80809aac5c5e service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:49.558621 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-bce8fde9-7b11-4f07-a61d-4c699cdb82c3 req-8fa08085-2b3f-45a0-90d7-80809aac5c5e service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:49.559159 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-bce8fde9-7b11-4f07-a61d-4c699cdb82c3 req-8fa08085-2b3f-45a0-90d7-80809aac5c5e service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:49.573613 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-bce8fde9-7b11-4f07-a61d-4c699cdb82c3 req-8fa08085-2b3f-45a0-90d7-80809aac5c5e service nova] Creating event network-changed:d8801e29-936f-4850-b8b8-729b8370c4bc for instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 on hv-cinder-85032 Sep 09 23:26:49.579308 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-bce8fde9-7b11-4f07-a61d-4c699cdb82c3 req-8fa08085-2b3f-45a0-90d7-80809aac5c5e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039246 Sep 09 23:26:49.580524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 377/727] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:49.723192 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ea897e3d-3fe9-47fd-afdb-904f18d7af91 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:49.728626 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ea897e3d-3fe9-47fd-afdb-904f18d7af91 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:49.730661 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ea897e3d-3fe9-47fd-afdb-904f18d7af91 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:49.731367 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ea897e3d-3fe9-47fd-afdb-904f18d7af91 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:49.732227 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ea897e3d-3fe9-47fd-afdb-904f18d7af91 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:49.733210 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ea897e3d-3fe9-47fd-afdb-904f18d7af91 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:49.734313 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ea897e3d-3fe9-47fd-afdb-904f18d7af91 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:49.734970 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ea897e3d-3fe9-47fd-afdb-904f18d7af91 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:49.819221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=6 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:49.899342 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ef5a15b3-a159-497b-8a70-481922a196e0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:49.900312 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ef5a15b3-a159-497b-8a70-481922a196e0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:49.909954 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef5a15b3-a159-497b-8a70-481922a196e0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:49.910659 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef5a15b3-a159-497b-8a70-481922a196e0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:49.911482 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef5a15b3-a159-497b-8a70-481922a196e0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:49.912614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef5a15b3-a159-497b-8a70-481922a196e0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:49.913237 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef5a15b3-a159-497b-8a70-481922a196e0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:49.913828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef5a15b3-a159-497b-8a70-481922a196e0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:49.939158 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ea897e3d-3fe9-47fd-afdb-904f18d7af91 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:49.948523 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ea897e3d-3fe9-47fd-afdb-904f18d7af91 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:49.954964 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ea897e3d-3fe9-47fd-afdb-904f18d7af91 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:49.956174 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ea897e3d-3fe9-47fd-afdb-904f18d7af91 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1407 microversion: 2.20 time: 0.246063 Sep 09 23:26:49.970369 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 351/728] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:49 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:50.201585 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1b6f4ec5-ff23-47a8-a9be-f04c886ab7be tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:50.203764 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-1b6f4ec5-ff23-47a8-a9be-f04c886ab7be tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:50.210825 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=22 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:50.213343 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b6f4ec5-ff23-47a8-a9be-f04c886ab7be tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:50.213871 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b6f4ec5-ff23-47a8-a9be-f04c886ab7be tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:50.215065 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b6f4ec5-ff23-47a8-a9be-f04c886ab7be tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:50.216734 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b6f4ec5-ff23-47a8-a9be-f04c886ab7be tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:50.218191 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b6f4ec5-ff23-47a8-a9be-f04c886ab7be tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:50.218986 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b6f4ec5-ff23-47a8-a9be-f04c886ab7be tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:50.241467 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ef5a15b3-a159-497b-8a70-481922a196e0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:50.257898 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ef5a15b3-a159-497b-8a70-481922a196e0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1363 microversion: 2.1 time: 0.363269 Sep 09 23:26:50.263550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 378/729] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:49 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:50.514226 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1b6f4ec5-ff23-47a8-a9be-f04c886ab7be tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:50.527501 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-1b6f4ec5-ff23-47a8-a9be-f04c886ab7be tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1259 microversion: 2.1 time: 0.330621 Sep 09 23:26:50.528441 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 352/730] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:50 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1259 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:50.986957 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c44e240b-9f62-4677-ba68-cdc0e6903bb0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:50.987568 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-c44e240b-9f62-4677-ba68-cdc0e6903bb0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:50.994421 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c44e240b-9f62-4677-ba68-cdc0e6903bb0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:50.995270 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c44e240b-9f62-4677-ba68-cdc0e6903bb0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:51.001236 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c44e240b-9f62-4677-ba68-cdc0e6903bb0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:51.001236 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c44e240b-9f62-4677-ba68-cdc0e6903bb0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:51.001236 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c44e240b-9f62-4677-ba68-cdc0e6903bb0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:51.001236 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c44e240b-9f62-4677-ba68-cdc0e6903bb0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:51.071493 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-c2a96229-d92d-4097-9e10-876e201f5752 req-61583f17-06d1-4828-880e-53d7f49443e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026e4485-df9d-411d-98da-db2109bcf03b", "name": "network-vif-plugged", "status": "completed", "tag": "0780d6cc-ab17-42a7-894c-8eff61ba4eab"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:51.091731 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c2a96229-d92d-4097-9e10-876e201f5752 req-61583f17-06d1-4828-880e-53d7f49443e2 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:51.092859 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c2a96229-d92d-4097-9e10-876e201f5752 req-61583f17-06d1-4828-880e-53d7f49443e2 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:51.094400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c2a96229-d92d-4097-9e10-876e201f5752 req-61583f17-06d1-4828-880e-53d7f49443e2 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:51.161771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-c2a96229-d92d-4097-9e10-876e201f5752 req-61583f17-06d1-4828-880e-53d7f49443e2 service nova] Creating event network-vif-plugged:0780d6cc-ab17-42a7-894c-8eff61ba4eab for instance 026e4485-df9d-411d-98da-db2109bcf03b on hv-cinder-85032 Sep 09 23:26:51.171619 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-c2a96229-d92d-4097-9e10-876e201f5752 req-61583f17-06d1-4828-880e-53d7f49443e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105672 Sep 09 23:26:51.173556 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 353/731] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:51.268350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-c44e240b-9f62-4677-ba68-cdc0e6903bb0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:51.284319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-c44e240b-9f62-4677-ba68-cdc0e6903bb0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:51.285765 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-c44e240b-9f62-4677-ba68-cdc0e6903bb0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:51.286923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-c44e240b-9f62-4677-ba68-cdc0e6903bb0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1407 microversion: 2.20 time: 0.305168 Sep 09 23:26:51.287666 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 379/732] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:50 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:51.308288 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b2589a6b-5272-482b-9328-3914603f70fb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:51.318973 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b2589a6b-5272-482b-9328-3914603f70fb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:51.329160 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b2589a6b-5272-482b-9328-3914603f70fb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:51.330139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b2589a6b-5272-482b-9328-3914603f70fb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:51.330684 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b2589a6b-5272-482b-9328-3914603f70fb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:51.331631 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b2589a6b-5272-482b-9328-3914603f70fb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:51.332269 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b2589a6b-5272-482b-9328-3914603f70fb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:51.332795 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b2589a6b-5272-482b-9328-3914603f70fb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:51.550978 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-65a71b75-17b9-4e99-a63b-4a82b9a0f137 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:51.551743 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-65a71b75-17b9-4e99-a63b-4a82b9a0f137 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:51.557856 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-65a71b75-17b9-4e99-a63b-4a82b9a0f137 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:51.558788 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-65a71b75-17b9-4e99-a63b-4a82b9a0f137 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:51.559396 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-65a71b75-17b9-4e99-a63b-4a82b9a0f137 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:51.560300 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-65a71b75-17b9-4e99-a63b-4a82b9a0f137 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:51.560739 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-65a71b75-17b9-4e99-a63b-4a82b9a0f137 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:51.561571 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-65a71b75-17b9-4e99-a63b-4a82b9a0f137 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:51.569698 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b2589a6b-5272-482b-9328-3914603f70fb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:51.580184 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b2589a6b-5272-482b-9328-3914603f70fb tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1363 microversion: 2.1 time: 0.297753 Sep 09 23:26:51.597897 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 354/733] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:51 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:51.603562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-9c90623e-da74-4254-ab6b-9d90670abf58 req-6abe14d7-6299-4894-9d8b-4f06e02b68e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a008236c-707a-4578-912c-07adedbb10cb", "tag": "b8c3dd2c-6785-40c3-87d8-e3d4dae738c5"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:51.618119 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-9c90623e-da74-4254-ab6b-9d90670abf58 req-6abe14d7-6299-4894-9d8b-4f06e02b68e6 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:51.618694 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-9c90623e-da74-4254-ab6b-9d90670abf58 req-6abe14d7-6299-4894-9d8b-4f06e02b68e6 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:51.622929 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-9c90623e-da74-4254-ab6b-9d90670abf58 req-6abe14d7-6299-4894-9d8b-4f06e02b68e6 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:51.643900 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-9c90623e-da74-4254-ab6b-9d90670abf58 req-6abe14d7-6299-4894-9d8b-4f06e02b68e6 service nova] Creating event network-changed:b8c3dd2c-6785-40c3-87d8-e3d4dae738c5 for instance a008236c-707a-4578-912c-07adedbb10cb on hv-cinder-85032 Sep 09 23:26:51.650572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-9c90623e-da74-4254-ab6b-9d90670abf58 req-6abe14d7-6299-4894-9d8b-4f06e02b68e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050569 Sep 09 23:26:51.650572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 355/734] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:51.747459 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-65a71b75-17b9-4e99-a63b-4a82b9a0f137 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:51.756892 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-65a71b75-17b9-4e99-a63b-4a82b9a0f137 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1442 microversion: 2.1 time: 0.209690 Sep 09 23:26:51.757709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 380/735] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:51 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1442 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:26:51.781761 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ed4805ef-8b1c-4536-89e4-e899efad14fb tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:51.782483 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ed4805ef-8b1c-4536-89e4-e899efad14fb tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:51.788676 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ed4805ef-8b1c-4536-89e4-e899efad14fb tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:51.789155 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ed4805ef-8b1c-4536-89e4-e899efad14fb tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:51.789612 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ed4805ef-8b1c-4536-89e4-e899efad14fb tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:51.790275 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ed4805ef-8b1c-4536-89e4-e899efad14fb tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:51.790749 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ed4805ef-8b1c-4536-89e4-e899efad14fb tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:51.791173 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ed4805ef-8b1c-4536-89e4-e899efad14fb tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:52.006148 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ed4805ef-8b1c-4536-89e4-e899efad14fb tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:52.015108 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ed4805ef-8b1c-4536-89e4-e899efad14fb tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1442 microversion: 2.1 time: 0.236754 Sep 09 23:26:52.016496 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 356/736] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:51 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1442 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:52.313572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fae78185-48df-47ae-8ed8-2bf2dff2b931 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:52.314199 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-fae78185-48df-47ae-8ed8-2bf2dff2b931 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:52.321312 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fae78185-48df-47ae-8ed8-2bf2dff2b931 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:52.322089 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fae78185-48df-47ae-8ed8-2bf2dff2b931 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:52.322566 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fae78185-48df-47ae-8ed8-2bf2dff2b931 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:52.323277 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fae78185-48df-47ae-8ed8-2bf2dff2b931 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:52.323775 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fae78185-48df-47ae-8ed8-2bf2dff2b931 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:52.324206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fae78185-48df-47ae-8ed8-2bf2dff2b931 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:52.604736 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a499dc5f-cb06-444d-bd58-99cf2f63cfa0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:52.605734 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a499dc5f-cb06-444d-bd58-99cf2f63cfa0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:52.616136 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a499dc5f-cb06-444d-bd58-99cf2f63cfa0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:52.616136 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a499dc5f-cb06-444d-bd58-99cf2f63cfa0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:52.616136 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a499dc5f-cb06-444d-bd58-99cf2f63cfa0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:52.616136 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a499dc5f-cb06-444d-bd58-99cf2f63cfa0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:52.616579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a499dc5f-cb06-444d-bd58-99cf2f63cfa0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:52.616961 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a499dc5f-cb06-444d-bd58-99cf2f63cfa0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:52.785553 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fae78185-48df-47ae-8ed8-2bf2dff2b931 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:52.794091 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fae78185-48df-47ae-8ed8-2bf2dff2b931 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:52.796198 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fae78185-48df-47ae-8ed8-2bf2dff2b931 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:52.807863 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-fae78185-48df-47ae-8ed8-2bf2dff2b931 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1407 microversion: 2.20 time: 0.499109 Sep 09 23:26:52.822625 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 381/737] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:52 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1407 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:52.862584 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a499dc5f-cb06-444d-bd58-99cf2f63cfa0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:52.871807 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a499dc5f-cb06-444d-bd58-99cf2f63cfa0 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1363 microversion: 2.1 time: 0.271128 Sep 09 23:26:52.873166 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 357/738] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:52 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:53.095860 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-9f9e2f44-003f-4c15-b7d2-525f88fa837b tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-367975644"}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:53.096435 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-9f9e2f44-003f-4c15-b7d2-525f88fa837b tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:53.103449 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f9e2f44-003f-4c15-b7d2-525f88fa837b tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:53.103936 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f9e2f44-003f-4c15-b7d2-525f88fa837b tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:53.104581 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f9e2f44-003f-4c15-b7d2-525f88fa837b tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:53.105286 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f9e2f44-003f-4c15-b7d2-525f88fa837b tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:53.105748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f9e2f44-003f-4c15-b7d2-525f88fa837b tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:53.106297 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9f9e2f44-003f-4c15-b7d2-525f88fa837b tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:53.364801 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.network.security_group_api [None req-9f9e2f44-003f-4c15-b7d2-525f88fa837b tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Adding security group e884058c-47be-4936-bae8-bb8939863864 to port d8801e29-936f-4850-b8b8-729b8370c4bc Sep 09 23:26:53.837141 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-75a7f03d-2bc0-4eae-9147-d943974f6a02 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:53.838369 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-75a7f03d-2bc0-4eae-9147-d943974f6a02 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:53.845562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-75a7f03d-2bc0-4eae-9147-d943974f6a02 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:53.846281 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-75a7f03d-2bc0-4eae-9147-d943974f6a02 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:53.846947 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-75a7f03d-2bc0-4eae-9147-d943974f6a02 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:53.847837 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-75a7f03d-2bc0-4eae-9147-d943974f6a02 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:53.848459 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-75a7f03d-2bc0-4eae-9147-d943974f6a02 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:53.849050 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-75a7f03d-2bc0-4eae-9147-d943974f6a02 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:53.872863 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=100 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:26:54.072686 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-75a7f03d-2bc0-4eae-9147-d943974f6a02 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:54.082368 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-75a7f03d-2bc0-4eae-9147-d943974f6a02 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:54.083962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-75a7f03d-2bc0-4eae-9147-d943974f6a02 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:54.085273 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-75a7f03d-2bc0-4eae-9147-d943974f6a02 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1407 microversion: 2.20 time: 0.251940 Sep 09 23:26:54.098546 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 358/739] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:53 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:54.105254 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-d4ea86a9-6c69-48a1-b152-61b12099fdfe tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:54.105871 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-d4ea86a9-6c69-48a1-b152-61b12099fdfe tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:54.112974 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4ea86a9-6c69-48a1-b152-61b12099fdfe tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:54.113469 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4ea86a9-6c69-48a1-b152-61b12099fdfe tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:54.115207 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4ea86a9-6c69-48a1-b152-61b12099fdfe tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:54.115207 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4ea86a9-6c69-48a1-b152-61b12099fdfe tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:54.115207 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4ea86a9-6c69-48a1-b152-61b12099fdfe tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:54.115481 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d4ea86a9-6c69-48a1-b152-61b12099fdfe tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:54.178166 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-9f9e2f44-003f-4c15-b7d2-525f88fa837b tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "POST /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/action" status: 202 len: 0 microversion: 2.1 time: 1.086963 Sep 09 23:26:54.182727 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 382/740] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 23:26:53 2022] POST /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/action => generated 0 bytes in 1093 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:26:54.190250 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-416534a2-a488-4e35-8119-c4af37f55f27 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:54.191070 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-416534a2-a488-4e35-8119-c4af37f55f27 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:54.207266 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-416534a2-a488-4e35-8119-c4af37f55f27 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:54.208348 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-416534a2-a488-4e35-8119-c4af37f55f27 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:54.208951 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-416534a2-a488-4e35-8119-c4af37f55f27 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:54.211374 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-416534a2-a488-4e35-8119-c4af37f55f27 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:54.212042 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-416534a2-a488-4e35-8119-c4af37f55f27 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:54.213350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-416534a2-a488-4e35-8119-c4af37f55f27 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:54.364139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d4ea86a9-6c69-48a1-b152-61b12099fdfe tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:54.377329 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-d4ea86a9-6c69-48a1-b152-61b12099fdfe tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1363 microversion: 2.1 time: 0.275769 Sep 09 23:26:54.377918 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 359/741] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:54 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:54.382583 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-99904b7e-4feb-4545-80e7-b79600a7a21a req-8897728d-387e-4ad4-9f3d-a6b9a45c5bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072aebfe-bdb3-47e7-9b55-deddc8c248e9", "tag": "d8801e29-936f-4850-b8b8-729b8370c4bc"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:54.407018 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-99904b7e-4feb-4545-80e7-b79600a7a21a req-8897728d-387e-4ad4-9f3d-a6b9a45c5bd4 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:54.408016 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-99904b7e-4feb-4545-80e7-b79600a7a21a req-8897728d-387e-4ad4-9f3d-a6b9a45c5bd4 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:54.408691 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-99904b7e-4feb-4545-80e7-b79600a7a21a req-8897728d-387e-4ad4-9f3d-a6b9a45c5bd4 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:54.429307 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-416534a2-a488-4e35-8119-c4af37f55f27 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:54.432385 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-99904b7e-4feb-4545-80e7-b79600a7a21a req-8897728d-387e-4ad4-9f3d-a6b9a45c5bd4 service nova] Creating event network-changed:d8801e29-936f-4850-b8b8-729b8370c4bc for instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 on hv-cinder-85032 Sep 09 23:26:54.438409 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-99904b7e-4feb-4545-80e7-b79600a7a21a req-8897728d-387e-4ad4-9f3d-a6b9a45c5bd4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059092 Sep 09 23:26:54.439289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 360/742] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:54.440105 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-416534a2-a488-4e35-8119-c4af37f55f27 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1758 microversion: 2.1 time: 0.256062 Sep 09 23:26:54.440756 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 383/743] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:54 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1758 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:55.113255 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b4f65b60-94ea-48e9-a512-82f478af64ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:55.113956 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b4f65b60-94ea-48e9-a512-82f478af64ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:55.130100 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b4f65b60-94ea-48e9-a512-82f478af64ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:55.130621 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b4f65b60-94ea-48e9-a512-82f478af64ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:55.131063 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b4f65b60-94ea-48e9-a512-82f478af64ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:55.131773 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b4f65b60-94ea-48e9-a512-82f478af64ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:55.132233 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b4f65b60-94ea-48e9-a512-82f478af64ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:55.132659 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b4f65b60-94ea-48e9-a512-82f478af64ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:55.310286 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b4f65b60-94ea-48e9-a512-82f478af64ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:55.319167 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b4f65b60-94ea-48e9-a512-82f478af64ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:55.320602 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b4f65b60-94ea-48e9-a512-82f478af64ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:55.321708 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b4f65b60-94ea-48e9-a512-82f478af64ba tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1407 microversion: 2.20 time: 0.213937 Sep 09 23:26:55.322294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 361/744] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:55 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:55.401823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3958aca7-d536-46db-8b1d-ce2a7add9c3e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:55.402655 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3958aca7-d536-46db-8b1d-ce2a7add9c3e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:55.425341 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3958aca7-d536-46db-8b1d-ce2a7add9c3e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:55.425881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3958aca7-d536-46db-8b1d-ce2a7add9c3e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:55.426305 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3958aca7-d536-46db-8b1d-ce2a7add9c3e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:55.429424 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3958aca7-d536-46db-8b1d-ce2a7add9c3e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:55.430228 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3958aca7-d536-46db-8b1d-ce2a7add9c3e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:55.432502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3958aca7-d536-46db-8b1d-ce2a7add9c3e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:55.857096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3958aca7-d536-46db-8b1d-ce2a7add9c3e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:55.869349 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3958aca7-d536-46db-8b1d-ce2a7add9c3e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1550 microversion: 2.1 time: 0.472207 Sep 09 23:26:55.870077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 384/745] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:26:55 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1550 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:26:55.895493 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ecff7fc2-05ed-4fa5-a9a9-8c94570ec2da tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:55.895987 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ecff7fc2-05ed-4fa5-a9a9-8c94570ec2da tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:55.902435 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ecff7fc2-05ed-4fa5-a9a9-8c94570ec2da tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:55.902992 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ecff7fc2-05ed-4fa5-a9a9-8c94570ec2da tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:55.903571 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ecff7fc2-05ed-4fa5-a9a9-8c94570ec2da tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:55.904276 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ecff7fc2-05ed-4fa5-a9a9-8c94570ec2da tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:55.905257 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ecff7fc2-05ed-4fa5-a9a9-8c94570ec2da tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:55.905900 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ecff7fc2-05ed-4fa5-a9a9-8c94570ec2da tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:56.025374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ecff7fc2-05ed-4fa5-a9a9-8c94570ec2da tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134216 Sep 09 23:26:56.026250 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 362/746] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 23:26:55 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:56.347872 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7e41c01d-dbfd-4ee8-bad6-24bb6a00d65b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:56.348680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7e41c01d-dbfd-4ee8-bad6-24bb6a00d65b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:56.356504 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7e41c01d-dbfd-4ee8-bad6-24bb6a00d65b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:56.357010 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7e41c01d-dbfd-4ee8-bad6-24bb6a00d65b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:56.357449 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7e41c01d-dbfd-4ee8-bad6-24bb6a00d65b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:56.366081 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7e41c01d-dbfd-4ee8-bad6-24bb6a00d65b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:56.366958 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7e41c01d-dbfd-4ee8-bad6-24bb6a00d65b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:56.367419 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7e41c01d-dbfd-4ee8-bad6-24bb6a00d65b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:56.491717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-7ecb222c-f098-4e09-97ef-072d3bc17994 req-90e5bd2b-71d5-4c57-9681-78ae8472ec3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d367ef-58a3-46c5-94d6-8723e6cca32b", "tag": "c92b2495-b9d4-4026-960c-2b98f517147e"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:56.510638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-7ecb222c-f098-4e09-97ef-072d3bc17994 req-90e5bd2b-71d5-4c57-9681-78ae8472ec3b service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:56.520654 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-7ecb222c-f098-4e09-97ef-072d3bc17994 req-90e5bd2b-71d5-4c57-9681-78ae8472ec3b service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:56.520654 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-7ecb222c-f098-4e09-97ef-072d3bc17994 req-90e5bd2b-71d5-4c57-9681-78ae8472ec3b service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:56.524952 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-7ecb222c-f098-4e09-97ef-072d3bc17994 req-90e5bd2b-71d5-4c57-9681-78ae8472ec3b service nova] Creating event network-changed:c92b2495-b9d4-4026-960c-2b98f517147e for instance 77d367ef-58a3-46c5-94d6-8723e6cca32b on hv-cinder-85032 Sep 09 23:26:56.530801 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-7ecb222c-f098-4e09-97ef-072d3bc17994 req-90e5bd2b-71d5-4c57-9681-78ae8472ec3b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042503 Sep 09 23:26:56.531923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 363/747] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:26:56.656764 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7e41c01d-dbfd-4ee8-bad6-24bb6a00d65b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:56.671431 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7e41c01d-dbfd-4ee8-bad6-24bb6a00d65b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:56.677818 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7e41c01d-dbfd-4ee8-bad6-24bb6a00d65b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:56.679499 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7e41c01d-dbfd-4ee8-bad6-24bb6a00d65b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1407 microversion: 2.20 time: 0.335387 Sep 09 23:26:56.680143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 385/748] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:56 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1407 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:56.852786 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9cb2469a-95bd-43d2-b59e-e413036de610 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Action: 'create', calling method: .version_select at 0x7f908db52f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-395594924", "metadata": {"Type": "work"}}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:56.874546 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-bc92b556-b0a3-4381-b694-206501459006 req-c15cb6c5-137f-451d-9de6-6cfa4f3701aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a008236c-707a-4578-912c-07adedbb10cb", "name": "network-vif-plugged", "status": "completed", "tag": "b8c3dd2c-6785-40c3-87d8-e3d4dae738c5"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9cb2469a-95bd-43d2-b59e-e413036de610 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Request method failure captured: Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 121 Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8vAUW750KbziJ4jRq_vAR3yt4ulZtMtZlgQklN9vBvlRT_wS7ffAR9RBxCdCS3ZHEJQIjhd1gUdhzMWYl8NgyVxRBmURyS9rGCi_DHQwjmToqtFgCsmRiGvlDajjRYb9SKCSNEegaKnp0hhMWdie-C2uZraZWrK0_icd1_SqeuIvkg Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 09fd57fff2274a8db0c953747f6091a8 Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:26:56.881882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:26:56.883428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09fd57fff2274a8db0c953747f6091a8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:26:56.883428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:56.883428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 09fd57fff2274a8db0c953747f6091a8 Sep 09 23:26:56.883428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:56.883428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-VolumesNegativeTest-1691110539-project Sep 09 23:26:56.883428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:26:56.883428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:26:56.883428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: ced067c9eab7411988b0845aee52dc93 Sep 09 23:26:56.883428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-VolumesNegativeTest-1691110539-project Sep 09 23:26:56.883428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Sep 09 23:26:56.883428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-395594924", "metadata": {"Type": "work"}}} Sep 09 23:26:56.883428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: Sep 09 23:26:56.883428 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-395594924', 'metadata': {'Type': 'work'}}}} Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise error Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi '#$%' Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:26:56.884245 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 23:26:56.885669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 23:26:56.887746 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 23:26:56.887746 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.887920 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-bc92b556-b0a3-4381-b694-206501459006 req-c15cb6c5-137f-451d-9de6-6cfa4f3701aa service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:56.888200 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-bc92b556-b0a3-4381-b694-206501459006 req-c15cb6c5-137f-451d-9de6-6cfa4f3701aa service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:56.890475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9cb2469a-95bd-43d2-b59e-e413036de610 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:26:56.890963 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-bc92b556-b0a3-4381-b694-206501459006 req-c15cb6c5-137f-451d-9de6-6cfa4f3701aa service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:56.891368 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9cb2469a-95bd-43d2-b59e-e413036de610 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.186489 Sep 09 23:26:56.892332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 364/749] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Sep 9 23:26:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:26:56.902477 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-42708670-280c-4843-9272-942983cc1589 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Action: 'create', calling method: .version_select at 0x7f908db1e040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-199559435", "metadata": {"Type": "work"}}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-42708670-280c-4843-9272-942983cc1589 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Request method failure captured: Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 119 Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8vAUW750KbziJ4jRq_vAR3yt4ulZtMtZlgQklN9vBvlRT_wS7ffAR9RBxCdCS3ZHEJQIjhd1gUdhzMWYl8NgyVxRBmURyS9rGCi_DHQwjmToqtFgCsmRiGvlDajjRYb9SKCSNEegaKnp0hhMWdie-C2uZraZWrK0_icd1_SqeuIvkg Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 09fd57fff2274a8db0c953747f6091a8 Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:26:56.907212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:26:56.908771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09fd57fff2274a8db0c953747f6091a8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:26:56.908771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:56.908771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 09fd57fff2274a8db0c953747f6091a8 Sep 09 23:26:56.908771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:56.908771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-VolumesNegativeTest-1691110539-project Sep 09 23:26:56.908771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:26:56.908771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:26:56.908771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: ced067c9eab7411988b0845aee52dc93 Sep 09 23:26:56.908771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-VolumesNegativeTest-1691110539-project Sep 09 23:26:56.908771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Sep 09 23:26:56.908771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-199559435", "metadata": {"Type": "work"}}} Sep 09 23:26:56.908771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: Sep 09 23:26:56.908771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-199559435', 'metadata': {'Type': 'work'}}}} Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise error Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi '0' Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:26:56.909705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 23:26:56.911377 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 23:26:56.912710 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 23:26:56.912710 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.912710 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-42708670-280c-4843-9272-942983cc1589 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:26:56.912710 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-42708670-280c-4843-9272-942983cc1589 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010980 Sep 09 23:26:56.912710 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 365/750] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Sep 9 23:26:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:26:56.913122 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-bc92b556-b0a3-4381-b694-206501459006 req-c15cb6c5-137f-451d-9de6-6cfa4f3701aa service nova] Creating event network-vif-plugged:b8c3dd2c-6785-40c3-87d8-e3d4dae738c5 for instance a008236c-707a-4578-912c-07adedbb10cb on hv-cinder-85032 Sep 09 23:26:56.920005 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-bc92b556-b0a3-4381-b694-206501459006 req-c15cb6c5-137f-451d-9de6-6cfa4f3701aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050008 Sep 09 23:26:56.921415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 386/751] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:56.926190 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-fd0b245b-341e-4ede-8ee4-0d1fc1c35002 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Action: 'create', calling method: .version_select at 0x7f908db2e280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-820929411", "metadata": {"Type": "work"}}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-fd0b245b-341e-4ede-8ee4-0d1fc1c35002 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Request method failure captured: Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 118 Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8vAUW750KbziJ4jRq_vAR3yt4ulZtMtZlgQklN9vBvlRT_wS7ffAR9RBxCdCS3ZHEJQIjhd1gUdhzMWYl8NgyVxRBmURyS9rGCi_DHQwjmToqtFgCsmRiGvlDajjRYb9SKCSNEegaKnp0hhMWdie-C2uZraZWrK0_icd1_SqeuIvkg Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 09fd57fff2274a8db0c953747f6091a8 Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:26:56.929927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:26:56.935425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09fd57fff2274a8db0c953747f6091a8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:26:56.935425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:56.935425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 09fd57fff2274a8db0c953747f6091a8 Sep 09 23:26:56.935425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:56.935425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-VolumesNegativeTest-1691110539-project Sep 09 23:26:56.935425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:26:56.935425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:26:56.935425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: ced067c9eab7411988b0845aee52dc93 Sep 09 23:26:56.935425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-VolumesNegativeTest-1691110539-project Sep 09 23:26:56.935425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Sep 09 23:26:56.935425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-820929411", "metadata": {"Type": "work"}}} Sep 09 23:26:56.935425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: Sep 09 23:26:56.935425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-820929411', 'metadata': {'Type': 'work'}}}} Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise error Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi '' Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:26:56.936297 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 23:26:56.937638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 23:26:56.938980 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 23:26:56.938980 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:56.938980 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-fd0b245b-341e-4ede-8ee4-0d1fc1c35002 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:26:56.938980 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-fd0b245b-341e-4ede-8ee4-0d1fc1c35002 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012048 Sep 09 23:26:56.938980 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 366/752] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Sep 9 23:26:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:26:56.943821 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-49c04f07-7054-4eb3-a038-5be8267dbc68 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Calling method '.version_select at 0x7f908dc60e50>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:56.999953 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-49c04f07-7054-4eb3-a038-5be8267dbc68 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] HTTP exception thrown: Volume tempest-invalid-472864320 could not be found. Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-49c04f07-7054-4eb3-a038-5be8267dbc68 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Request method failure captured: Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-472864320 HTTP/1.1 Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8vAUW750KbziJ4jRq_vAR3yt4ulZtMtZlgQklN9vBvlRT_wS7ffAR9RBxCdCS3ZHEJQIjhd1gUdhzMWYl8NgyVxRBmURyS9rGCi_DHQwjmToqtFgCsmRiGvlDajjRYb9SKCSNEegaKnp0hhMWdie-C2uZraZWrK0_icd1_SqeuIvkg Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 09fd57fff2274a8db0c953747f6091a8 Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:26:57.002532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:26:57.004127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09fd57fff2274a8db0c953747f6091a8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:26:57.004127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:57.004127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 09fd57fff2274a8db0c953747f6091a8 Sep 09 23:26:57.004127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:57.004127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-VolumesNegativeTest-1691110539-project Sep 09 23:26:57.004127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:26:57.004127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:26:57.004127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: ced067c9eab7411988b0845aee52dc93 Sep 09 23:26:57.004127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-VolumesNegativeTest-1691110539-project Sep 09 23:26:57.004127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: Sep 09 23:26:57.004127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Volume tempest-invalid-472864320 could not be found. Sep 09 23:26:57.004127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': 'tempest-invalid-472864320'} Sep 09 23:26:57.004127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-472864320 could not be found. (HTTP 404) (Request-ID: req-3788ded3-44e2-437a-a800-c82d35aebc4a) Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:57.005102 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 23:26:57.006737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-472864320 could not be found. Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:26:57.007992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-472864320 could not be found. Sep 09 23:26:57.009172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.009172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:57.009172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.009172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:57.009172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:57.009172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:57.009172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:26:57.009172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:26:57.009172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-472864320 could not be found. Sep 09 23:26:57.009172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.009172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-49c04f07-7054-4eb3-a038-5be8267dbc68 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Returning 404 to user: Volume tempest-invalid-472864320 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:26:57.009172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-49c04f07-7054-4eb3-a038-5be8267dbc68 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-472864320" status: 404 len: 98 microversion: 2.1 time: 0.065410 Sep 09 23:26:57.010058 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 387/753] 10.222.0.20 () {58 vars in 1215 bytes} [Fri Sep 9 23:26:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-472864320 => generated 98 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 09 23:26:57.017189 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-48864212-f075-462e-8101-bbfd5e438a05 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006650 Sep 09 23:26:57.018873 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 367/754] 10.222.0.20 () {58 vars in 1140 bytes} [Fri Sep 9 23:26:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 23:26:57.032750 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-90a6795a-d0aa-4c86-8a1e-eedcaecdc71c tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005691 Sep 09 23:26:57.038191 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 388/755] 10.222.0.20 () {58 vars in 1137 bytes} [Fri Sep 9 23:26:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 23:26:57.042796 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-2bec64c7-9ee3-47cf-a6bc-4065754f24c6 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Calling method '.version_select at 0x7f908dd3ea60>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:57.079846 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-2bec64c7-9ee3-47cf-a6bc-4065754f24c6 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] HTTP exception thrown: Volume 6597ec72-a019-4456-a36b-7a430df8c385 could not be found. Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-2bec64c7-9ee3-47cf-a6bc-4065754f24c6 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Request method failure captured: Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: DELETE /compute/v2.1/os-volumes/6597ec72-a019-4456-a36b-7a430df8c385 HTTP/1.1 Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8vAUW750KbziJ4jRq_vAR3yt4ulZtMtZlgQklN9vBvlRT_wS7ffAR9RBxCdCS3ZHEJQIjhd1gUdhzMWYl8NgyVxRBmURyS9rGCi_DHQwjmToqtFgCsmRiGvlDajjRYb9SKCSNEegaKnp0hhMWdie-C2uZraZWrK0_icd1_SqeuIvkg Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 09fd57fff2274a8db0c953747f6091a8 Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:26:57.081332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:26:57.082762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09fd57fff2274a8db0c953747f6091a8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:26:57.082762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:57.082762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 09fd57fff2274a8db0c953747f6091a8 Sep 09 23:26:57.082762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:57.082762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-VolumesNegativeTest-1691110539-project Sep 09 23:26:57.082762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:26:57.082762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:26:57.082762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: ced067c9eab7411988b0845aee52dc93 Sep 09 23:26:57.082762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-VolumesNegativeTest-1691110539-project Sep 09 23:26:57.082762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: Sep 09 23:26:57.082762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Volume 6597ec72-a019-4456-a36b-7a430df8c385 could not be found. Sep 09 23:26:57.082762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '6597ec72-a019-4456-a36b-7a430df8c385'} Sep 09 23:26:57.082762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6597ec72-a019-4456-a36b-7a430df8c385 could not be found. (HTTP 404) (Request-ID: req-53206566-8927-42e0-9431-de90417e8fad) Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:57.083879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 23:26:57.085383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6597ec72-a019-4456-a36b-7a430df8c385 could not be found. Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 23:26:57.086484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:26:57.087750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6597ec72-a019-4456-a36b-7a430df8c385 could not be found. Sep 09 23:26:57.087750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.087750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:57.087750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.087750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:57.087750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:57.087750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:57.087750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:26:57.087750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:26:57.087750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6597ec72-a019-4456-a36b-7a430df8c385 could not be found. Sep 09 23:26:57.087750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.087750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-2bec64c7-9ee3-47cf-a6bc-4065754f24c6 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Returning 404 to user: Volume 6597ec72-a019-4456-a36b-7a430df8c385 could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:26:57.087750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-2bec64c7-9ee3-47cf-a6bc-4065754f24c6 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/6597ec72-a019-4456-a36b-7a430df8c385" status: 404 len: 109 microversion: 2.1 time: 0.043709 Sep 09 23:26:57.087750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 368/756] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 23:26:57 2022] DELETE /compute/v2.1/os-volumes/6597ec72-a019-4456-a36b-7a430df8c385 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:26:57.094540 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-478f7a04-f847-4ea1-a931-533ec858d316 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Calling method '.version_select at 0x7f908dbb5430>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:57.130566 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-478f7a04-f847-4ea1-a931-533ec858d316 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] HTTP exception thrown: Volume 7bcfaeee-1d17-4885-833a-8ab5c32446c8 could not be found. Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-478f7a04-f847-4ea1-a931-533ec858d316 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Request method failure captured: Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/os-volumes/7bcfaeee-1d17-4885-833a-8ab5c32446c8 HTTP/1.1 Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8vAUW750KbziJ4jRq_vAR3yt4ulZtMtZlgQklN9vBvlRT_wS7ffAR9RBxCdCS3ZHEJQIjhd1gUdhzMWYl8NgyVxRBmURyS9rGCi_DHQwjmToqtFgCsmRiGvlDajjRYb9SKCSNEegaKnp0hhMWdie-C2uZraZWrK0_icd1_SqeuIvkg Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 09fd57fff2274a8db0c953747f6091a8 Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:26:57.132680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:26:57.133991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09fd57fff2274a8db0c953747f6091a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09fd57fff2274a8db0c953747f6091a8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:26:57.133991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:57.133991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 09fd57fff2274a8db0c953747f6091a8 Sep 09 23:26:57.133991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-VolumesNegativeTest-1691110539 Sep 09 23:26:57.133991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-VolumesNegativeTest-1691110539-project Sep 09 23:26:57.133991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:26:57.133991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:26:57.133991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: ced067c9eab7411988b0845aee52dc93 Sep 09 23:26:57.133991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-VolumesNegativeTest-1691110539-project Sep 09 23:26:57.133991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: Sep 09 23:26:57.133991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Volume 7bcfaeee-1d17-4885-833a-8ab5c32446c8 could not be found. Sep 09 23:26:57.133991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '7bcfaeee-1d17-4885-833a-8ab5c32446c8'} Sep 09 23:26:57.133991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7bcfaeee-1d17-4885-833a-8ab5c32446c8 could not be found. (HTTP 404) (Request-ID: req-f1ee610e-6975-4ce4-ad18-f685f91be290) Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:57.135006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:26:57.136258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7bcfaeee-1d17-4885-833a-8ab5c32446c8 could not be found. Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 23:26:57.137390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:26:57.143767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7bcfaeee-1d17-4885-833a-8ab5c32446c8 could not be found. Sep 09 23:26:57.143767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.143767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:26:57.143767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.143767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:26:57.143767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:26:57.143767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:26:57.143767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:26:57.143767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:26:57.143767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7bcfaeee-1d17-4885-833a-8ab5c32446c8 could not be found. Sep 09 23:26:57.143767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:26:57.143767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-478f7a04-f847-4ea1-a931-533ec858d316 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] Returning 404 to user: Volume 7bcfaeee-1d17-4885-833a-8ab5c32446c8 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:26:57.143767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-478f7a04-f847-4ea1-a931-533ec858d316 tempest-VolumesNegativeTest-1691110539 tempest-VolumesNegativeTest-1691110539-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/7bcfaeee-1d17-4885-833a-8ab5c32446c8" status: 404 len: 109 microversion: 2.1 time: 0.051077 Sep 09 23:26:57.143767 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 389/757] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 23:26:57 2022] GET /compute/v2.1/os-volumes/7bcfaeee-1d17-4885-833a-8ab5c32446c8 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:26:57.706562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-658f1f80-7901-4132-a334-21712d2fd2de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:57.707487 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-658f1f80-7901-4132-a334-21712d2fd2de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:57.722779 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-658f1f80-7901-4132-a334-21712d2fd2de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:57.723361 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-658f1f80-7901-4132-a334-21712d2fd2de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:57.723978 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-658f1f80-7901-4132-a334-21712d2fd2de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:57.724950 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-658f1f80-7901-4132-a334-21712d2fd2de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:57.725400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-658f1f80-7901-4132-a334-21712d2fd2de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:57.725989 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-658f1f80-7901-4132-a334-21712d2fd2de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:57.874806 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-658f1f80-7901-4132-a334-21712d2fd2de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:57.883913 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-658f1f80-7901-4132-a334-21712d2fd2de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:57.885350 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-658f1f80-7901-4132-a334-21712d2fd2de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:57.886483 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-658f1f80-7901-4132-a334-21712d2fd2de tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1407 microversion: 2.20 time: 0.185034 Sep 09 23:26:57.887106 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 369/758] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:57 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:26:58.570502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-135461d8-68e0-4639-81d5-ef07ce1095e1 req-c40c8146-1a26-4639-a0b1-640da7123f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "026e4485-df9d-411d-98da-db2109bcf03b", "tag": "0780d6cc-ab17-42a7-894c-8eff61ba4eab"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:26:58.581794 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-135461d8-68e0-4639-81d5-ef07ce1095e1 req-c40c8146-1a26-4639-a0b1-640da7123f82 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:58.582281 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-135461d8-68e0-4639-81d5-ef07ce1095e1 req-c40c8146-1a26-4639-a0b1-640da7123f82 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:58.582736 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-135461d8-68e0-4639-81d5-ef07ce1095e1 req-c40c8146-1a26-4639-a0b1-640da7123f82 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:58.594140 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-135461d8-68e0-4639-81d5-ef07ce1095e1 req-c40c8146-1a26-4639-a0b1-640da7123f82 service nova] Creating event network-changed:0780d6cc-ab17-42a7-894c-8eff61ba4eab for instance 026e4485-df9d-411d-98da-db2109bcf03b on hv-cinder-85032 Sep 09 23:26:58.599138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-135461d8-68e0-4639-81d5-ef07ce1095e1 req-c40c8146-1a26-4639-a0b1-640da7123f82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032901 Sep 09 23:26:58.600030 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 390/759] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:26:58.913005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4d973792-aa06-455a-a4e8-fdcba359c053 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:26:58.913609 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4d973792-aa06-455a-a4e8-fdcba359c053 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:26:58.921090 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4d973792-aa06-455a-a4e8-fdcba359c053 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:58.921765 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4d973792-aa06-455a-a4e8-fdcba359c053 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:58.922203 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4d973792-aa06-455a-a4e8-fdcba359c053 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:58.922921 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4d973792-aa06-455a-a4e8-fdcba359c053 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:26:58.923374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4d973792-aa06-455a-a4e8-fdcba359c053 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:26:58.923796 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4d973792-aa06-455a-a4e8-fdcba359c053 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:26:59.082152 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4d973792-aa06-455a-a4e8-fdcba359c053 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:59.090905 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4d973792-aa06-455a-a4e8-fdcba359c053 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:59.093269 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4d973792-aa06-455a-a4e8-fdcba359c053 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:26:59.094832 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4d973792-aa06-455a-a4e8-fdcba359c053 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1407 microversion: 2.20 time: 0.185767 Sep 09 23:26:59.112069 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 370/760] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:26:58 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:27:00.123747 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-287e5727-d757-4f83-a20a-45cfb7674439 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:00.125158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-287e5727-d757-4f83-a20a-45cfb7674439 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:00.131480 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-287e5727-d757-4f83-a20a-45cfb7674439 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:00.132011 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-287e5727-d757-4f83-a20a-45cfb7674439 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:00.132487 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-287e5727-d757-4f83-a20a-45cfb7674439 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:00.133217 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-287e5727-d757-4f83-a20a-45cfb7674439 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:00.133728 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-287e5727-d757-4f83-a20a-45cfb7674439 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:00.134313 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-287e5727-d757-4f83-a20a-45cfb7674439 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:00.272241 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-287e5727-d757-4f83-a20a-45cfb7674439 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:00.281383 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-287e5727-d757-4f83-a20a-45cfb7674439 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:00.282917 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-287e5727-d757-4f83-a20a-45cfb7674439 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:00.284068 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-287e5727-d757-4f83-a20a-45cfb7674439 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1598 microversion: 2.20 time: 0.165405 Sep 09 23:27:00.284624 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 391/761] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:27:00 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:27:00.309464 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9f4740da-8e2b-489b-a12d-84263911fa4c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:00.310067 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9f4740da-8e2b-489b-a12d-84263911fa4c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:00.316858 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9f4740da-8e2b-489b-a12d-84263911fa4c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:00.317429 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9f4740da-8e2b-489b-a12d-84263911fa4c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:00.317945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9f4740da-8e2b-489b-a12d-84263911fa4c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:00.318746 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9f4740da-8e2b-489b-a12d-84263911fa4c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:00.319352 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9f4740da-8e2b-489b-a12d-84263911fa4c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:00.319850 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9f4740da-8e2b-489b-a12d-84263911fa4c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:00.400729 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9f4740da-8e2b-489b-a12d-84263911fa4c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095409 Sep 09 23:27:00.401333 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 371/762] 10.222.0.20 () {60 vars in 1316 bytes} [Fri Sep 9 23:27:00 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:27:01.405085 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-f455f582-dda2-4f6c-8ec8-b938d2324116 req-a13bc896-0ea8-4005-9120-3a3b598c9efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a008236c-707a-4578-912c-07adedbb10cb", "tag": "b8c3dd2c-6785-40c3-87d8-e3d4dae738c5"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:27:01.415225 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-f455f582-dda2-4f6c-8ec8-b938d2324116 req-a13bc896-0ea8-4005-9120-3a3b598c9efa service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:01.415805 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-f455f582-dda2-4f6c-8ec8-b938d2324116 req-a13bc896-0ea8-4005-9120-3a3b598c9efa service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:01.416699 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-f455f582-dda2-4f6c-8ec8-b938d2324116 req-a13bc896-0ea8-4005-9120-3a3b598c9efa service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:01.428738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-f455f582-dda2-4f6c-8ec8-b938d2324116 req-a13bc896-0ea8-4005-9120-3a3b598c9efa service nova] Creating event network-changed:b8c3dd2c-6785-40c3-87d8-e3d4dae738c5 for instance a008236c-707a-4578-912c-07adedbb10cb on hv-cinder-85032 Sep 09 23:27:01.433594 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-f455f582-dda2-4f6c-8ec8-b938d2324116 req-a13bc896-0ea8-4005-9120-3a3b598c9efa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032233 Sep 09 23:27:01.434179 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 392/763] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:27:14.069312 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=60 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:27:14.070067 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=38 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:27:14.074139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ebe2cdcc-60a5-48fe-a57f-41cb4447e4b3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:27:14.076541 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ebe2cdcc-60a5-48fe-a57f-41cb4447e4b3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:14.082501 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ebe2cdcc-60a5-48fe-a57f-41cb4447e4b3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:14.082993 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ebe2cdcc-60a5-48fe-a57f-41cb4447e4b3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:14.083438 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ebe2cdcc-60a5-48fe-a57f-41cb4447e4b3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:14.084470 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ebe2cdcc-60a5-48fe-a57f-41cb4447e4b3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:14.084640 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ebe2cdcc-60a5-48fe-a57f-41cb4447e4b3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:14.085067 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ebe2cdcc-60a5-48fe-a57f-41cb4447e4b3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:14.449109 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ebe2cdcc-60a5-48fe-a57f-41cb4447e4b3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "POST /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/action" status: 202 len: 0 microversion: 2.1 time: 0.380948 Sep 09 23:27:14.449892 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 372/764] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 23:27:14 2022] POST /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:27:14.457156 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=46 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:27:14.458591 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=68 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:27:14.463205 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-963d946d-afdd-47bd-83d2-290909a8f93c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:14.463973 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-963d946d-afdd-47bd-83d2-290909a8f93c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:14.470993 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-963d946d-afdd-47bd-83d2-290909a8f93c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:14.471692 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-963d946d-afdd-47bd-83d2-290909a8f93c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:14.472522 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-963d946d-afdd-47bd-83d2-290909a8f93c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:14.473237 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-963d946d-afdd-47bd-83d2-290909a8f93c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:14.474028 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-963d946d-afdd-47bd-83d2-290909a8f93c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:14.474126 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-963d946d-afdd-47bd-83d2-290909a8f93c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:14.681315 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-963d946d-afdd-47bd-83d2-290909a8f93c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:14.694710 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-963d946d-afdd-47bd-83d2-290909a8f93c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1750 microversion: 2.1 time: 0.240476 Sep 09 23:27:14.695838 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 393/765] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:14 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1750 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:15.720353 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-cb292f84-b43c-439c-884d-e088a5f54878 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:15.721116 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-cb292f84-b43c-439c-884d-e088a5f54878 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:15.728966 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cb292f84-b43c-439c-884d-e088a5f54878 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:15.729454 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cb292f84-b43c-439c-884d-e088a5f54878 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:15.729895 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cb292f84-b43c-439c-884d-e088a5f54878 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:15.730615 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cb292f84-b43c-439c-884d-e088a5f54878 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:15.731075 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cb292f84-b43c-439c-884d-e088a5f54878 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:15.731506 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cb292f84-b43c-439c-884d-e088a5f54878 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:15.875685 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-cb292f84-b43c-439c-884d-e088a5f54878 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:15.884608 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-cb292f84-b43c-439c-884d-e088a5f54878 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1755 microversion: 2.1 time: 0.168473 Sep 09 23:27:15.885196 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 373/766] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:15 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:16.910877 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e3116605-d897-45a6-be05-382845f3d29e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:16.911489 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e3116605-d897-45a6-be05-382845f3d29e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:16.919077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3116605-d897-45a6-be05-382845f3d29e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:16.919077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3116605-d897-45a6-be05-382845f3d29e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:16.919077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3116605-d897-45a6-be05-382845f3d29e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:16.919709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3116605-d897-45a6-be05-382845f3d29e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:16.920164 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3116605-d897-45a6-be05-382845f3d29e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:16.920582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3116605-d897-45a6-be05-382845f3d29e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:17.069535 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e3116605-d897-45a6-be05-382845f3d29e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:17.077961 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e3116605-d897-45a6-be05-382845f3d29e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1755 microversion: 2.1 time: 0.170895 Sep 09 23:27:17.078555 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 394/767] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:16 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:18.101075 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-bf7ef803-7bc1-45b0-a14b-1322afe2ae16 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:18.106485 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-bf7ef803-7bc1-45b0-a14b-1322afe2ae16 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:18.108137 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bf7ef803-7bc1-45b0-a14b-1322afe2ae16 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:18.108621 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bf7ef803-7bc1-45b0-a14b-1322afe2ae16 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:18.109313 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bf7ef803-7bc1-45b0-a14b-1322afe2ae16 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:18.110010 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bf7ef803-7bc1-45b0-a14b-1322afe2ae16 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:18.110501 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bf7ef803-7bc1-45b0-a14b-1322afe2ae16 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:18.110953 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bf7ef803-7bc1-45b0-a14b-1322afe2ae16 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:18.283013 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bf7ef803-7bc1-45b0-a14b-1322afe2ae16 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:18.291415 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-bf7ef803-7bc1-45b0-a14b-1322afe2ae16 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1755 microversion: 2.1 time: 0.194297 Sep 09 23:27:18.292064 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 374/768] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:18 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:19.314992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8b9de22a-8880-46e9-b876-6991df2a9028 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:19.315710 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8b9de22a-8880-46e9-b876-6991df2a9028 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:19.322928 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b9de22a-8880-46e9-b876-6991df2a9028 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:19.323634 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b9de22a-8880-46e9-b876-6991df2a9028 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:19.324072 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b9de22a-8880-46e9-b876-6991df2a9028 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:19.324754 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b9de22a-8880-46e9-b876-6991df2a9028 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:19.325206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b9de22a-8880-46e9-b876-6991df2a9028 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:19.325630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b9de22a-8880-46e9-b876-6991df2a9028 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:19.486706 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8b9de22a-8880-46e9-b876-6991df2a9028 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:19.495994 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8b9de22a-8880-46e9-b876-6991df2a9028 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1755 microversion: 2.1 time: 0.185180 Sep 09 23:27:19.496558 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 395/769] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:19 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:20.523142 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e39bf5e4-e9fd-4ab5-b234-cc8b097b9b4c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:20.523752 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e39bf5e4-e9fd-4ab5-b234-cc8b097b9b4c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:20.529971 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e39bf5e4-e9fd-4ab5-b234-cc8b097b9b4c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:20.530514 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e39bf5e4-e9fd-4ab5-b234-cc8b097b9b4c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:20.530943 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e39bf5e4-e9fd-4ab5-b234-cc8b097b9b4c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:20.531630 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e39bf5e4-e9fd-4ab5-b234-cc8b097b9b4c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:20.532104 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e39bf5e4-e9fd-4ab5-b234-cc8b097b9b4c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:20.532493 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e39bf5e4-e9fd-4ab5-b234-cc8b097b9b4c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:20.677785 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e39bf5e4-e9fd-4ab5-b234-cc8b097b9b4c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:20.686993 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e39bf5e4-e9fd-4ab5-b234-cc8b097b9b4c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1755 microversion: 2.1 time: 0.168363 Sep 09 23:27:20.687669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 375/770] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:20 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:21.711241 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e1ea32f7-3fad-4d5c-9b4a-69ec1bf23e89 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:21.715710 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e1ea32f7-3fad-4d5c-9b4a-69ec1bf23e89 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:21.718025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e1ea32f7-3fad-4d5c-9b4a-69ec1bf23e89 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:21.718538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e1ea32f7-3fad-4d5c-9b4a-69ec1bf23e89 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:21.718967 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e1ea32f7-3fad-4d5c-9b4a-69ec1bf23e89 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:21.719643 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e1ea32f7-3fad-4d5c-9b4a-69ec1bf23e89 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:21.720092 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e1ea32f7-3fad-4d5c-9b4a-69ec1bf23e89 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:21.720512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e1ea32f7-3fad-4d5c-9b4a-69ec1bf23e89 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:21.862012 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e1ea32f7-3fad-4d5c-9b4a-69ec1bf23e89 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:21.871094 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e1ea32f7-3fad-4d5c-9b4a-69ec1bf23e89 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1755 microversion: 2.1 time: 0.163691 Sep 09 23:27:21.871660 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 396/771] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:21 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:22.894001 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-15c3abb0-749a-4f0d-a35b-3d457f2b0b01 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:22.894921 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-15c3abb0-749a-4f0d-a35b-3d457f2b0b01 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:22.901259 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-15c3abb0-749a-4f0d-a35b-3d457f2b0b01 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:22.901741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-15c3abb0-749a-4f0d-a35b-3d457f2b0b01 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:22.902177 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-15c3abb0-749a-4f0d-a35b-3d457f2b0b01 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:22.902902 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-15c3abb0-749a-4f0d-a35b-3d457f2b0b01 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:22.903359 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-15c3abb0-749a-4f0d-a35b-3d457f2b0b01 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:22.903786 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-15c3abb0-749a-4f0d-a35b-3d457f2b0b01 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:23.047165 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-15c3abb0-749a-4f0d-a35b-3d457f2b0b01 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:23.052251 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-15c3abb0-749a-4f0d-a35b-3d457f2b0b01 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1755 microversion: 2.1 time: 0.162160 Sep 09 23:27:23.052814 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 376/772] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:22 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:24.076026 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a87a0194-7c3c-49c9-a83c-ed872360ef07 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:24.076673 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a87a0194-7c3c-49c9-a83c-ed872360ef07 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:24.083203 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a87a0194-7c3c-49c9-a83c-ed872360ef07 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:24.083684 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a87a0194-7c3c-49c9-a83c-ed872360ef07 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:24.084122 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a87a0194-7c3c-49c9-a83c-ed872360ef07 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:24.084812 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a87a0194-7c3c-49c9-a83c-ed872360ef07 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:24.085265 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a87a0194-7c3c-49c9-a83c-ed872360ef07 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:24.085688 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a87a0194-7c3c-49c9-a83c-ed872360ef07 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:24.234561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a87a0194-7c3c-49c9-a83c-ed872360ef07 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:24.243043 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a87a0194-7c3c-49c9-a83c-ed872360ef07 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1755 microversion: 2.1 time: 0.170845 Sep 09 23:27:24.243613 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 397/773] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:24 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:25.266181 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7aad76bb-bae8-44b5-ac89-a8bc859aec64 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:25.266852 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7aad76bb-bae8-44b5-ac89-a8bc859aec64 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:25.274065 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7aad76bb-bae8-44b5-ac89-a8bc859aec64 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:25.274580 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7aad76bb-bae8-44b5-ac89-a8bc859aec64 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:25.275017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7aad76bb-bae8-44b5-ac89-a8bc859aec64 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:25.275696 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7aad76bb-bae8-44b5-ac89-a8bc859aec64 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:25.276145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7aad76bb-bae8-44b5-ac89-a8bc859aec64 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:25.276565 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7aad76bb-bae8-44b5-ac89-a8bc859aec64 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:25.429322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7aad76bb-bae8-44b5-ac89-a8bc859aec64 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:25.437614 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7aad76bb-bae8-44b5-ac89-a8bc859aec64 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1755 microversion: 2.1 time: 0.175272 Sep 09 23:27:25.438188 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 377/774] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:25 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:26.461946 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-13ab552f-8b65-4551-844d-2bc3dccb67c3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:26.462588 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-13ab552f-8b65-4551-844d-2bc3dccb67c3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:26.468595 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-13ab552f-8b65-4551-844d-2bc3dccb67c3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:26.469083 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-13ab552f-8b65-4551-844d-2bc3dccb67c3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:26.469521 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-13ab552f-8b65-4551-844d-2bc3dccb67c3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:26.470207 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-13ab552f-8b65-4551-844d-2bc3dccb67c3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:26.470702 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-13ab552f-8b65-4551-844d-2bc3dccb67c3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:26.471127 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-13ab552f-8b65-4551-844d-2bc3dccb67c3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:26.615034 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-13ab552f-8b65-4551-844d-2bc3dccb67c3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:26.623141 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-13ab552f-8b65-4551-844d-2bc3dccb67c3 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1755 microversion: 2.1 time: 0.165266 Sep 09 23:27:26.623703 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 398/775] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:26 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:27.646559 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-2cecc8be-096c-445d-a31c-b85a0d6e8f12 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:27.647180 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-2cecc8be-096c-445d-a31c-b85a0d6e8f12 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:27.653522 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2cecc8be-096c-445d-a31c-b85a0d6e8f12 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:27.654004 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2cecc8be-096c-445d-a31c-b85a0d6e8f12 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:27.654468 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2cecc8be-096c-445d-a31c-b85a0d6e8f12 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:27.655159 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2cecc8be-096c-445d-a31c-b85a0d6e8f12 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:27.655616 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2cecc8be-096c-445d-a31c-b85a0d6e8f12 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:27.656046 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2cecc8be-096c-445d-a31c-b85a0d6e8f12 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:27.797362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-2cecc8be-096c-445d-a31c-b85a0d6e8f12 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:27.806049 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-2cecc8be-096c-445d-a31c-b85a0d6e8f12 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1755 microversion: 2.1 time: 0.163990 Sep 09 23:27:27.806871 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 378/776] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:27 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:28.829733 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-da94c377-2a09-4a7c-be56-06cfffbb7d35 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:28.830363 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-da94c377-2a09-4a7c-be56-06cfffbb7d35 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:28.837346 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-da94c377-2a09-4a7c-be56-06cfffbb7d35 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:28.837828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-da94c377-2a09-4a7c-be56-06cfffbb7d35 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:28.838265 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-da94c377-2a09-4a7c-be56-06cfffbb7d35 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:28.838978 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-da94c377-2a09-4a7c-be56-06cfffbb7d35 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:28.839436 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-da94c377-2a09-4a7c-be56-06cfffbb7d35 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:28.839859 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-da94c377-2a09-4a7c-be56-06cfffbb7d35 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:28.982389 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-da94c377-2a09-4a7c-be56-06cfffbb7d35 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:28.991347 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-da94c377-2a09-4a7c-be56-06cfffbb7d35 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1755 microversion: 2.1 time: 0.165457 Sep 09 23:27:28.992112 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 399/777] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:28 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:30.014740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b242c51a-672e-40e6-996e-28eb41210545 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:30.015355 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b242c51a-672e-40e6-996e-28eb41210545 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:30.022735 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b242c51a-672e-40e6-996e-28eb41210545 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:30.023220 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b242c51a-672e-40e6-996e-28eb41210545 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:30.023661 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b242c51a-672e-40e6-996e-28eb41210545 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:30.024353 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b242c51a-672e-40e6-996e-28eb41210545 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:30.024813 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b242c51a-672e-40e6-996e-28eb41210545 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:30.025241 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b242c51a-672e-40e6-996e-28eb41210545 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:30.163300 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b242c51a-672e-40e6-996e-28eb41210545 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:30.171571 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b242c51a-672e-40e6-996e-28eb41210545 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1755 microversion: 2.1 time: 0.160787 Sep 09 23:27:30.172126 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 379/778] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:30 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:31.194847 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-aaddf4ab-395c-4cc6-846c-58a767e0a9ee tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:31.195455 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-aaddf4ab-395c-4cc6-846c-58a767e0a9ee tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:31.201766 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aaddf4ab-395c-4cc6-846c-58a767e0a9ee tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:31.202240 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aaddf4ab-395c-4cc6-846c-58a767e0a9ee tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:31.202707 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aaddf4ab-395c-4cc6-846c-58a767e0a9ee tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:31.203384 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aaddf4ab-395c-4cc6-846c-58a767e0a9ee tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:31.203832 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aaddf4ab-395c-4cc6-846c-58a767e0a9ee tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:31.204260 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aaddf4ab-395c-4cc6-846c-58a767e0a9ee tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:31.348539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-aaddf4ab-395c-4cc6-846c-58a767e0a9ee tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:31.356987 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-aaddf4ab-395c-4cc6-846c-58a767e0a9ee tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1755 microversion: 2.1 time: 0.166061 Sep 09 23:27:31.357571 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 400/779] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:31 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:32.380178 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4b41bbea-64ce-4a2a-9400-a4ccb245ceca tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:32.380771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4b41bbea-64ce-4a2a-9400-a4ccb245ceca tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:32.386870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b41bbea-64ce-4a2a-9400-a4ccb245ceca tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:32.387350 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b41bbea-64ce-4a2a-9400-a4ccb245ceca tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:32.387781 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b41bbea-64ce-4a2a-9400-a4ccb245ceca tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:32.388462 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b41bbea-64ce-4a2a-9400-a4ccb245ceca tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:32.388913 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b41bbea-64ce-4a2a-9400-a4ccb245ceca tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:32.389336 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b41bbea-64ce-4a2a-9400-a4ccb245ceca tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:32.536183 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4b41bbea-64ce-4a2a-9400-a4ccb245ceca tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:32.544369 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4b41bbea-64ce-4a2a-9400-a4ccb245ceca tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1755 microversion: 2.1 time: 0.168132 Sep 09 23:27:32.544931 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 380/780] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:32 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:33.567384 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-cf2738f3-46fa-45e9-98d8-69d7a35a4859 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:33.568001 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-cf2738f3-46fa-45e9-98d8-69d7a35a4859 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:33.574429 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cf2738f3-46fa-45e9-98d8-69d7a35a4859 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:33.574913 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cf2738f3-46fa-45e9-98d8-69d7a35a4859 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:33.575347 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cf2738f3-46fa-45e9-98d8-69d7a35a4859 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:33.576036 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cf2738f3-46fa-45e9-98d8-69d7a35a4859 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:33.576491 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cf2738f3-46fa-45e9-98d8-69d7a35a4859 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:33.576914 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cf2738f3-46fa-45e9-98d8-69d7a35a4859 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:33.842498 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cf2738f3-46fa-45e9-98d8-69d7a35a4859 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:33.842498 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-cf2738f3-46fa-45e9-98d8-69d7a35a4859 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1758 microversion: 2.1 time: 0.170635 Sep 09 23:27:33.842498 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 401/781] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:27:33 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:27:50.895356 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-bd147b81-25f5-4951-b99b-06a2a3562cd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:50.895912 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-bd147b81-25f5-4951-b99b-06a2a3562cd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:50.898615 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=18 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:27:50.903149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:27:50.904391 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bd147b81-25f5-4951-b99b-06a2a3562cd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:50.904871 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bd147b81-25f5-4951-b99b-06a2a3562cd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:50.905305 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bd147b81-25f5-4951-b99b-06a2a3562cd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:50.905993 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bd147b81-25f5-4951-b99b-06a2a3562cd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:50.906470 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bd147b81-25f5-4951-b99b-06a2a3562cd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:50.906895 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bd147b81-25f5-4951-b99b-06a2a3562cd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:50.931023 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-bd147b81-25f5-4951-b99b-06a2a3562cd2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/ips" status: 200 len: 146 microversion: 2.1 time: 0.040000 Sep 09 23:27:50.931589 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 381/782] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 23:27:50 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:27:52.511370 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e42a8c81-3c2e-4653-bf74-1d468dc4038a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2591a82-efa2-45e3-bfe1-dfc6cf3ef471"}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:27:52.513685 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e42a8c81-3c2e-4653-bf74-1d468dc4038a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:52.516231 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=18 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:27:52.516896 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=54 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:27:52.522642 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e42a8c81-3c2e-4653-bf74-1d468dc4038a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:52.523233 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e42a8c81-3c2e-4653-bf74-1d468dc4038a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:52.523806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e42a8c81-3c2e-4653-bf74-1d468dc4038a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:52.524616 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e42a8c81-3c2e-4653-bf74-1d468dc4038a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:52.525262 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e42a8c81-3c2e-4653-bf74-1d468dc4038a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:52.525779 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e42a8c81-3c2e-4653-bf74-1d468dc4038a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:53.237440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e42a8c81-3c2e-4653-bf74-1d468dc4038a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "POST /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.729931 Sep 09 23:27:53.238086 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 402/783] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 23:27:52 2022] POST /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments => generated 194 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:27:56.965818 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-43916cb4-1d66-44c6-95fe-33db6d00b75a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:56.966320 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-43916cb4-1d66-44c6-95fe-33db6d00b75a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:56.972604 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43916cb4-1d66-44c6-95fe-33db6d00b75a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:56.973290 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43916cb4-1d66-44c6-95fe-33db6d00b75a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:56.973909 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43916cb4-1d66-44c6-95fe-33db6d00b75a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:56.974636 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43916cb4-1d66-44c6-95fe-33db6d00b75a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:56.975093 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43916cb4-1d66-44c6-95fe-33db6d00b75a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:56.975523 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-43916cb4-1d66-44c6-95fe-33db6d00b75a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:56.999212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-43916cb4-1d66-44c6-95fe-33db6d00b75a tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb/ips" status: 200 len: 150 microversion: 2.20 time: 0.269752 Sep 09 23:27:56.999774 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 382/784] 10.222.0.20 () {60 vars in 1289 bytes} [Fri Sep 9 23:27:56 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb/ips => generated 150 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:27:59.107471 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b683e8fd-41bf-41be-ac30-e41ce6486cac tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:27:59.108264 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b683e8fd-41bf-41be-ac30-e41ce6486cac tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:59.115506 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b683e8fd-41bf-41be-ac30-e41ce6486cac tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:59.116091 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b683e8fd-41bf-41be-ac30-e41ce6486cac tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:59.116534 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b683e8fd-41bf-41be-ac30-e41ce6486cac tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:59.117267 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b683e8fd-41bf-41be-ac30-e41ce6486cac tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:59.117727 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b683e8fd-41bf-41be-ac30-e41ce6486cac tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:59.118159 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b683e8fd-41bf-41be-ac30-e41ce6486cac tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:59.140853 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-b683e8fd-41bf-41be-ac30-e41ce6486cac tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lazy-loading 'flavor' on Instance uuid a008236c-707a-4578-912c-07adedbb10cb {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:27:59.646605 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b683e8fd-41bf-41be-ac30-e41ce6486cac tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "POST /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb/action" status: 202 len: 0 microversion: 2.20 time: 0.543754 Sep 09 23:27:59.647964 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 403/785] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Sep 9 23:27:59 2022] POST /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:27:59.656534 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-f0f00d7e-2694-490f-8609-95369274ac41 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:27:59.659487 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-f0f00d7e-2694-490f-8609-95369274ac41 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:27:59.668816 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0f00d7e-2694-490f-8609-95369274ac41 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:59.669726 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0f00d7e-2694-490f-8609-95369274ac41 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:59.670489 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0f00d7e-2694-490f-8609-95369274ac41 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:59.679650 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0f00d7e-2694-490f-8609-95369274ac41 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:27:59.679650 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0f00d7e-2694-490f-8609-95369274ac41 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:27:59.679650 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-f0f00d7e-2694-490f-8609-95369274ac41 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:27:59.843569 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-f0f00d7e-2694-490f-8609-95369274ac41 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:59.855661 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-f0f00d7e-2694-490f-8609-95369274ac41 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:59.857102 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-f0f00d7e-2694-490f-8609-95369274ac41 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:27:59.858264 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-f0f00d7e-2694-490f-8609-95369274ac41 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.206000 Sep 09 23:27:59.858854 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 383/786] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:27:59 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:28:00.835816 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-38351dd4-6790-4695-abf0-4d24fd5ca30b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:00.847617 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-38351dd4-6790-4695-abf0-4d24fd5ca30b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:00.847617 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-38351dd4-6790-4695-abf0-4d24fd5ca30b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:00.847617 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-38351dd4-6790-4695-abf0-4d24fd5ca30b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:00.847617 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-38351dd4-6790-4695-abf0-4d24fd5ca30b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:00.848003 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-38351dd4-6790-4695-abf0-4d24fd5ca30b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:00.848003 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-38351dd4-6790-4695-abf0-4d24fd5ca30b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:00.848003 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-38351dd4-6790-4695-abf0-4d24fd5ca30b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:00.879073 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-38351dd4-6790-4695-abf0-4d24fd5ca30b tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048092 Sep 09 23:28:00.879741 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 404/787] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:28:00 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:28:00.885560 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b62b3f9e-e022-45ce-ac87-7278b9e30b78 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:00.886455 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b62b3f9e-e022-45ce-ac87-7278b9e30b78 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:00.890695 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-db9b87a1-0030-40e6-996c-cbce7eee681a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:00.891193 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-db9b87a1-0030-40e6-996c-cbce7eee681a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:00.892802 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b62b3f9e-e022-45ce-ac87-7278b9e30b78 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:00.893372 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b62b3f9e-e022-45ce-ac87-7278b9e30b78 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:00.894014 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b62b3f9e-e022-45ce-ac87-7278b9e30b78 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:00.894538 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b62b3f9e-e022-45ce-ac87-7278b9e30b78 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:00.895001 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b62b3f9e-e022-45ce-ac87-7278b9e30b78 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:00.895425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b62b3f9e-e022-45ce-ac87-7278b9e30b78 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:00.897659 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-db9b87a1-0030-40e6-996c-cbce7eee681a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:00.898182 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-db9b87a1-0030-40e6-996c-cbce7eee681a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:00.898664 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-db9b87a1-0030-40e6-996c-cbce7eee681a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:00.899363 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-db9b87a1-0030-40e6-996c-cbce7eee681a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:00.899822 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-db9b87a1-0030-40e6-996c-cbce7eee681a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:00.900253 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-db9b87a1-0030-40e6-996c-cbce7eee681a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:00.933894 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-db9b87a1-0030-40e6-996c-cbce7eee681a tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments/a2591a82-efa2-45e3-bfe1-dfc6cf3ef471" status: 200 len: 194 microversion: 2.1 time: 0.044167 Sep 09 23:28:00.933894 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 405/788] 10.222.0.20 () {58 vars in 1413 bytes} [Fri Sep 9 23:28:00 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments/a2591a82-efa2-45e3-bfe1-dfc6cf3ef471 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:28:01.077425 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b62b3f9e-e022-45ce-ac87-7278b9e30b78 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:01.083364 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b62b3f9e-e022-45ce-ac87-7278b9e30b78 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:01.085182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b62b3f9e-e022-45ce-ac87-7278b9e30b78 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:01.086517 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b62b3f9e-e022-45ce-ac87-7278b9e30b78 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.205830 Sep 09 23:28:01.086977 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 384/789] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:00 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:28:02.112434 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-6a948bbf-00d1-471e-8da7-b28c965f60d6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:02.113075 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-6a948bbf-00d1-471e-8da7-b28c965f60d6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:02.119511 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6a948bbf-00d1-471e-8da7-b28c965f60d6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:02.120002 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6a948bbf-00d1-471e-8da7-b28c965f60d6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:02.120446 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6a948bbf-00d1-471e-8da7-b28c965f60d6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:02.121144 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6a948bbf-00d1-471e-8da7-b28c965f60d6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:02.121604 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6a948bbf-00d1-471e-8da7-b28c965f60d6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:02.122037 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6a948bbf-00d1-471e-8da7-b28c965f60d6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:02.255280 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-6a948bbf-00d1-471e-8da7-b28c965f60d6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:02.264452 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-6a948bbf-00d1-471e-8da7-b28c965f60d6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:02.265830 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-6a948bbf-00d1-471e-8da7-b28c965f60d6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:02.267108 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-6a948bbf-00d1-471e-8da7-b28c965f60d6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.158944 Sep 09 23:28:02.267645 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 406/790] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:02 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:02.685333 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ac6c7e45-b546-491c-ac5a-285b0633b3e6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e353a49-ef8b-4c83-8491-e9945c7c487a"}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:28:02.687840 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ac6c7e45-b546-491c-ac5a-285b0633b3e6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:02.694417 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ac6c7e45-b546-491c-ac5a-285b0633b3e6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:02.694905 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ac6c7e45-b546-491c-ac5a-285b0633b3e6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:02.695337 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ac6c7e45-b546-491c-ac5a-285b0633b3e6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:02.696028 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ac6c7e45-b546-491c-ac5a-285b0633b3e6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:02.696480 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ac6c7e45-b546-491c-ac5a-285b0633b3e6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:02.696902 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ac6c7e45-b546-491c-ac5a-285b0633b3e6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:03.293967 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-bdd1486c-b874-4dc4-8019-7fb6ebc1f468 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:03.295346 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-bdd1486c-b874-4dc4-8019-7fb6ebc1f468 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:03.303046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bdd1486c-b874-4dc4-8019-7fb6ebc1f468 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:03.303838 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bdd1486c-b874-4dc4-8019-7fb6ebc1f468 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:03.304437 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bdd1486c-b874-4dc4-8019-7fb6ebc1f468 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:03.305343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bdd1486c-b874-4dc4-8019-7fb6ebc1f468 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:03.308904 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bdd1486c-b874-4dc4-8019-7fb6ebc1f468 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:03.308904 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bdd1486c-b874-4dc4-8019-7fb6ebc1f468 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:03.387065 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ac6c7e45-b546-491c-ac5a-285b0633b3e6 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "POST /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.706174 Sep 09 23:28:03.388695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 385/791] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 23:28:02 2022] POST /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments => generated 194 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:28:03.445277 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-bdd1486c-b874-4dc4-8019-7fb6ebc1f468 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:03.453640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-bdd1486c-b874-4dc4-8019-7fb6ebc1f468 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:03.455385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-bdd1486c-b874-4dc4-8019-7fb6ebc1f468 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:03.456553 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-bdd1486c-b874-4dc4-8019-7fb6ebc1f468 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.166474 Sep 09 23:28:03.457084 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 407/792] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:03 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:28:04.482286 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-67affef3-5533-40db-88f3-7f41b8fc1673 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:04.483002 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-67affef3-5533-40db-88f3-7f41b8fc1673 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:04.489288 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-67affef3-5533-40db-88f3-7f41b8fc1673 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:04.490368 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-67affef3-5533-40db-88f3-7f41b8fc1673 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:04.490804 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-67affef3-5533-40db-88f3-7f41b8fc1673 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:04.491494 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-67affef3-5533-40db-88f3-7f41b8fc1673 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:04.492058 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-67affef3-5533-40db-88f3-7f41b8fc1673 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:04.492361 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-67affef3-5533-40db-88f3-7f41b8fc1673 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:04.626664 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-67affef3-5533-40db-88f3-7f41b8fc1673 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:04.635668 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-67affef3-5533-40db-88f3-7f41b8fc1673 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:04.637100 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-67affef3-5533-40db-88f3-7f41b8fc1673 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:04.638256 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-67affef3-5533-40db-88f3-7f41b8fc1673 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.160643 Sep 09 23:28:04.638834 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 386/793] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:04 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:05.664336 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8942ec35-fa7d-47b4-b36a-f4d51f7b2f48 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:05.664859 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8942ec35-fa7d-47b4-b36a-f4d51f7b2f48 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:05.671169 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8942ec35-fa7d-47b4-b36a-f4d51f7b2f48 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:05.671646 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8942ec35-fa7d-47b4-b36a-f4d51f7b2f48 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:05.672109 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8942ec35-fa7d-47b4-b36a-f4d51f7b2f48 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:05.672790 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8942ec35-fa7d-47b4-b36a-f4d51f7b2f48 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:05.673240 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8942ec35-fa7d-47b4-b36a-f4d51f7b2f48 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:05.673660 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8942ec35-fa7d-47b4-b36a-f4d51f7b2f48 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:05.799791 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8942ec35-fa7d-47b4-b36a-f4d51f7b2f48 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:05.808742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8942ec35-fa7d-47b4-b36a-f4d51f7b2f48 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:05.810201 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8942ec35-fa7d-47b4-b36a-f4d51f7b2f48 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:05.811375 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8942ec35-fa7d-47b4-b36a-f4d51f7b2f48 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.151731 Sep 09 23:28:05.812051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 408/794] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:05 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:06.837753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1d636616-0b5a-4971-8d31-b2816e3eda7f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:06.838955 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-1d636616-0b5a-4971-8d31-b2816e3eda7f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:06.845811 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d636616-0b5a-4971-8d31-b2816e3eda7f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:06.846427 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d636616-0b5a-4971-8d31-b2816e3eda7f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:06.846877 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d636616-0b5a-4971-8d31-b2816e3eda7f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:06.847579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d636616-0b5a-4971-8d31-b2816e3eda7f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:06.848079 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d636616-0b5a-4971-8d31-b2816e3eda7f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:06.848726 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d636616-0b5a-4971-8d31-b2816e3eda7f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:06.979799 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1d636616-0b5a-4971-8d31-b2816e3eda7f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:06.988132 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1d636616-0b5a-4971-8d31-b2816e3eda7f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:06.990204 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1d636616-0b5a-4971-8d31-b2816e3eda7f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:06.994709 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-1d636616-0b5a-4971-8d31-b2816e3eda7f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.157891 Sep 09 23:28:06.994709 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 387/795] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:06 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:08.016722 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3ddfe601-5147-43db-8e09-1b1c17d1e0fb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:08.017328 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3ddfe601-5147-43db-8e09-1b1c17d1e0fb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:08.024440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ddfe601-5147-43db-8e09-1b1c17d1e0fb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:08.024921 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ddfe601-5147-43db-8e09-1b1c17d1e0fb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:08.025355 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ddfe601-5147-43db-8e09-1b1c17d1e0fb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:08.026040 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ddfe601-5147-43db-8e09-1b1c17d1e0fb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:08.026529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ddfe601-5147-43db-8e09-1b1c17d1e0fb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:08.026957 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ddfe601-5147-43db-8e09-1b1c17d1e0fb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:08.159167 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3ddfe601-5147-43db-8e09-1b1c17d1e0fb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:08.168258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3ddfe601-5147-43db-8e09-1b1c17d1e0fb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:08.169736 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3ddfe601-5147-43db-8e09-1b1c17d1e0fb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:08.170949 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3ddfe601-5147-43db-8e09-1b1c17d1e0fb tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.158057 Sep 09 23:28:08.171497 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 409/796] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:08 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:09.198013 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b339f90c-b84f-40ec-894c-3fcba31de877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:09.198719 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b339f90c-b84f-40ec-894c-3fcba31de877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:09.205086 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b339f90c-b84f-40ec-894c-3fcba31de877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:09.205563 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b339f90c-b84f-40ec-894c-3fcba31de877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:09.205998 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b339f90c-b84f-40ec-894c-3fcba31de877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:09.206750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b339f90c-b84f-40ec-894c-3fcba31de877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:09.207202 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b339f90c-b84f-40ec-894c-3fcba31de877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:09.207624 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b339f90c-b84f-40ec-894c-3fcba31de877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:09.339190 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b339f90c-b84f-40ec-894c-3fcba31de877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:09.347187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b339f90c-b84f-40ec-894c-3fcba31de877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:09.348669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b339f90c-b84f-40ec-894c-3fcba31de877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:09.349941 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b339f90c-b84f-40ec-894c-3fcba31de877 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.156479 Sep 09 23:28:09.350556 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 388/797] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:09 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:10.376369 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-661dc159-a677-494f-8b72-a6b512a5610e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:10.376978 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-661dc159-a677-494f-8b72-a6b512a5610e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:10.391104 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-661dc159-a677-494f-8b72-a6b512a5610e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:10.391531 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-661dc159-a677-494f-8b72-a6b512a5610e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:10.391969 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-661dc159-a677-494f-8b72-a6b512a5610e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:10.392664 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-661dc159-a677-494f-8b72-a6b512a5610e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:10.393118 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-661dc159-a677-494f-8b72-a6b512a5610e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:10.393544 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-661dc159-a677-494f-8b72-a6b512a5610e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:10.524352 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-661dc159-a677-494f-8b72-a6b512a5610e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:10.532825 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-661dc159-a677-494f-8b72-a6b512a5610e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:10.534264 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-661dc159-a677-494f-8b72-a6b512a5610e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:10.535461 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-661dc159-a677-494f-8b72-a6b512a5610e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.163134 Sep 09 23:28:10.536018 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 410/798] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:10 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:10.952336 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-397c49c2-b763-4c9b-bcaf-26c8cdfcaded tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:10.954622 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-397c49c2-b763-4c9b-bcaf-26c8cdfcaded tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:10.961289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-397c49c2-b763-4c9b-bcaf-26c8cdfcaded tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:10.961779 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-397c49c2-b763-4c9b-bcaf-26c8cdfcaded tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:10.962300 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-397c49c2-b763-4c9b-bcaf-26c8cdfcaded tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:10.963026 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-397c49c2-b763-4c9b-bcaf-26c8cdfcaded tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:10.963487 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-397c49c2-b763-4c9b-bcaf-26c8cdfcaded tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:10.963919 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-397c49c2-b763-4c9b-bcaf-26c8cdfcaded tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:11.000379 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-397c49c2-b763-4c9b-bcaf-26c8cdfcaded tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051954 Sep 09 23:28:11.004724 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 389/799] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:28:10 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:28:11.143748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8e834d55-2d59-4d70-9cb3-58489be2a995 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:11.144167 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8e834d55-2d59-4d70-9cb3-58489be2a995 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:11.150482 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e834d55-2d59-4d70-9cb3-58489be2a995 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:11.162056 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e834d55-2d59-4d70-9cb3-58489be2a995 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:11.162056 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e834d55-2d59-4d70-9cb3-58489be2a995 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:11.162056 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e834d55-2d59-4d70-9cb3-58489be2a995 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:11.162056 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e834d55-2d59-4d70-9cb3-58489be2a995 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:11.163503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e834d55-2d59-4d70-9cb3-58489be2a995 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:11.184027 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8e834d55-2d59-4d70-9cb3-58489be2a995 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments/a2591a82-efa2-45e3-bfe1-dfc6cf3ef471" status: 200 len: 194 microversion: 2.1 time: 0.044418 Sep 09 23:28:11.184593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 411/800] 10.222.0.20 () {58 vars in 1413 bytes} [Fri Sep 9 23:28:11 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments/a2591a82-efa2-45e3-bfe1-dfc6cf3ef471 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:28:11.196087 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4b9d9d5c-93e8-4302-94af-007b6ec91e02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:11.196591 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4b9d9d5c-93e8-4302-94af-007b6ec91e02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:11.202485 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b9d9d5c-93e8-4302-94af-007b6ec91e02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:11.202964 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b9d9d5c-93e8-4302-94af-007b6ec91e02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:11.203399 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b9d9d5c-93e8-4302-94af-007b6ec91e02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:11.204115 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b9d9d5c-93e8-4302-94af-007b6ec91e02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:11.204572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b9d9d5c-93e8-4302-94af-007b6ec91e02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:11.204995 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b9d9d5c-93e8-4302-94af-007b6ec91e02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:11.291738 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-4b9d9d5c-93e8-4302-94af-007b6ec91e02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lazy-loading 'services' on Instance uuid 026e4485-df9d-411d-98da-db2109bcf03b {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:28:11.483933 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4b9d9d5c-93e8-4302-94af-007b6ec91e02 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "DELETE /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments/a2591a82-efa2-45e3-bfe1-dfc6cf3ef471" status: 202 len: 0 microversion: 2.1 time: 0.292242 Sep 09 23:28:11.484537 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 390/801] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 23:28:11 2022] DELETE /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments/a2591a82-efa2-45e3-bfe1-dfc6cf3ef471 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:28:11.561724 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ab795844-5ac7-4b0d-840e-36255a63f4c1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:11.562438 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ab795844-5ac7-4b0d-840e-36255a63f4c1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:11.568994 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab795844-5ac7-4b0d-840e-36255a63f4c1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:11.569479 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab795844-5ac7-4b0d-840e-36255a63f4c1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:11.569920 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab795844-5ac7-4b0d-840e-36255a63f4c1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:11.570649 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab795844-5ac7-4b0d-840e-36255a63f4c1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:11.571107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab795844-5ac7-4b0d-840e-36255a63f4c1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:11.571534 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ab795844-5ac7-4b0d-840e-36255a63f4c1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:11.704439 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ab795844-5ac7-4b0d-840e-36255a63f4c1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:11.712708 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ab795844-5ac7-4b0d-840e-36255a63f4c1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:11.714145 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ab795844-5ac7-4b0d-840e-36255a63f4c1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:11.715341 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ab795844-5ac7-4b0d-840e-36255a63f4c1 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.157886 Sep 09 23:28:11.715891 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 412/802] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:11 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:12.732999 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8a075c12-e9b0-4747-a696-38ad7aecbde8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:12.733646 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8a075c12-e9b0-4747-a696-38ad7aecbde8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:12.742459 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8a075c12-e9b0-4747-a696-38ad7aecbde8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:12.742952 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8a075c12-e9b0-4747-a696-38ad7aecbde8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:12.743537 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8a075c12-e9b0-4747-a696-38ad7aecbde8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:12.743985 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-53fe6efe-4b3a-48da-91d3-0816c85b8e26 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:12.744434 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8a075c12-e9b0-4747-a696-38ad7aecbde8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:12.744613 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-53fe6efe-4b3a-48da-91d3-0816c85b8e26 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:12.744696 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8a075c12-e9b0-4747-a696-38ad7aecbde8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:12.745238 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8a075c12-e9b0-4747-a696-38ad7aecbde8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:12.751756 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53fe6efe-4b3a-48da-91d3-0816c85b8e26 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:12.752241 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53fe6efe-4b3a-48da-91d3-0816c85b8e26 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:12.755140 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53fe6efe-4b3a-48da-91d3-0816c85b8e26 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:12.756606 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53fe6efe-4b3a-48da-91d3-0816c85b8e26 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:12.757603 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53fe6efe-4b3a-48da-91d3-0816c85b8e26 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:12.758600 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-53fe6efe-4b3a-48da-91d3-0816c85b8e26 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:12.784629 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8a075c12-e9b0-4747-a696-38ad7aecbde8 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments/9e353a49-ef8b-4c83-8491-e9945c7c487a" status: 200 len: 194 microversion: 2.1 time: 0.059776 Sep 09 23:28:12.785978 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 391/803] 10.222.0.20 () {58 vars in 1413 bytes} [Fri Sep 9 23:28:12 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments/9e353a49-ef8b-4c83-8491-e9945c7c487a => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:28:12.797206 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-02e861f5-8a20-4c11-95d8-e298cc539fd4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:12.797954 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-02e861f5-8a20-4c11-95d8-e298cc539fd4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:12.804252 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02e861f5-8a20-4c11-95d8-e298cc539fd4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:12.804736 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02e861f5-8a20-4c11-95d8-e298cc539fd4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:12.805169 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02e861f5-8a20-4c11-95d8-e298cc539fd4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:12.805861 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02e861f5-8a20-4c11-95d8-e298cc539fd4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:12.806309 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02e861f5-8a20-4c11-95d8-e298cc539fd4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:12.806791 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02e861f5-8a20-4c11-95d8-e298cc539fd4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:12.893118 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-02e861f5-8a20-4c11-95d8-e298cc539fd4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lazy-loading 'services' on Instance uuid 026e4485-df9d-411d-98da-db2109bcf03b {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:28:12.903780 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-53fe6efe-4b3a-48da-91d3-0816c85b8e26 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:12.918452 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-53fe6efe-4b3a-48da-91d3-0816c85b8e26 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:12.918452 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-53fe6efe-4b3a-48da-91d3-0816c85b8e26 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:12.918452 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-53fe6efe-4b3a-48da-91d3-0816c85b8e26 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.177042 Sep 09 23:28:12.919121 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 413/804] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:12 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:13.073483 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-02e861f5-8a20-4c11-95d8-e298cc539fd4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "DELETE /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments/9e353a49-ef8b-4c83-8491-e9945c7c487a" status: 202 len: 0 microversion: 2.1 time: 0.280855 Sep 09 23:28:13.074076 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 392/805] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 23:28:12 2022] DELETE /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments/9e353a49-ef8b-4c83-8491-e9945c7c487a => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 23:28:13.941066 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5a1c0ef6-4bcc-4d9a-a092-ca18d11f11e5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:13.944710 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5a1c0ef6-4bcc-4d9a-a092-ca18d11f11e5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:13.948780 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5a1c0ef6-4bcc-4d9a-a092-ca18d11f11e5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:13.949281 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5a1c0ef6-4bcc-4d9a-a092-ca18d11f11e5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:13.949718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5a1c0ef6-4bcc-4d9a-a092-ca18d11f11e5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:13.950454 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5a1c0ef6-4bcc-4d9a-a092-ca18d11f11e5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:13.950915 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5a1c0ef6-4bcc-4d9a-a092-ca18d11f11e5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:13.951343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5a1c0ef6-4bcc-4d9a-a092-ca18d11f11e5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:14.085374 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5a1c0ef6-4bcc-4d9a-a092-ca18d11f11e5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:14.094159 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5a1c0ef6-4bcc-4d9a-a092-ca18d11f11e5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:14.095644 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5a1c0ef6-4bcc-4d9a-a092-ca18d11f11e5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:14.097524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5a1c0ef6-4bcc-4d9a-a092-ca18d11f11e5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.159656 Sep 09 23:28:14.098095 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 414/806] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:13 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:14.257153 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-db8552ae-c56f-4087-ae2b-ee1ee543ac70 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:14.259548 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-db8552ae-c56f-4087-ae2b-ee1ee543ac70 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:14.266289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-db8552ae-c56f-4087-ae2b-ee1ee543ac70 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:14.266806 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-db8552ae-c56f-4087-ae2b-ee1ee543ac70 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:14.267247 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-db8552ae-c56f-4087-ae2b-ee1ee543ac70 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:14.267950 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-db8552ae-c56f-4087-ae2b-ee1ee543ac70 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:14.268409 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-db8552ae-c56f-4087-ae2b-ee1ee543ac70 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:14.268910 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-db8552ae-c56f-4087-ae2b-ee1ee543ac70 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:14.300348 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-db8552ae-c56f-4087-ae2b-ee1ee543ac70 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049123 Sep 09 23:28:14.301186 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 393/807] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:28:14 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:28:14.423807 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f1fd9ebb-47a0-47f3-be29-d221f1fc6df4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:14.429857 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f1fd9ebb-47a0-47f3-be29-d221f1fc6df4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:14.435788 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f1fd9ebb-47a0-47f3-be29-d221f1fc6df4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:14.436273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f1fd9ebb-47a0-47f3-be29-d221f1fc6df4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:14.436701 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f1fd9ebb-47a0-47f3-be29-d221f1fc6df4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:14.437394 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f1fd9ebb-47a0-47f3-be29-d221f1fc6df4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:14.437848 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f1fd9ebb-47a0-47f3-be29-d221f1fc6df4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:14.438269 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f1fd9ebb-47a0-47f3-be29-d221f1fc6df4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:14.442159 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:28:14.469147 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f1fd9ebb-47a0-47f3-be29-d221f1fc6df4 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049763 Sep 09 23:28:14.469620 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 415/808] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:28:14 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:28:14.534874 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5c0ef675-0328-49dc-98c2-a04ca94a5563 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:14.535393 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5c0ef675-0328-49dc-98c2-a04ca94a5563 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:14.541705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5c0ef675-0328-49dc-98c2-a04ca94a5563 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:14.542405 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5c0ef675-0328-49dc-98c2-a04ca94a5563 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:14.542852 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5c0ef675-0328-49dc-98c2-a04ca94a5563 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:14.543551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5c0ef675-0328-49dc-98c2-a04ca94a5563 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:14.544015 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5c0ef675-0328-49dc-98c2-a04ca94a5563 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:14.544448 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5c0ef675-0328-49dc-98c2-a04ca94a5563 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:14.571115 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5c0ef675-0328-49dc-98c2-a04ca94a5563 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Going to try to terminate instance {{(pid=121058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:28:14.599853 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:28:14.822455 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5c0ef675-0328-49dc-98c2-a04ca94a5563 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "DELETE /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 204 len: 0 microversion: 2.1 time: 0.291054 Sep 09 23:28:14.824239 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 394/809] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:28:14 2022] DELETE /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:28:14.832633 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c5c77ad9-bdc5-45f6-9d13-7779586312c2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:14.833272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-c5c77ad9-bdc5-45f6-9d13-7779586312c2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:14.840561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c5c77ad9-bdc5-45f6-9d13-7779586312c2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:14.841050 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c5c77ad9-bdc5-45f6-9d13-7779586312c2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:14.841484 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c5c77ad9-bdc5-45f6-9d13-7779586312c2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:14.842176 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c5c77ad9-bdc5-45f6-9d13-7779586312c2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:14.842654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c5c77ad9-bdc5-45f6-9d13-7779586312c2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:14.843075 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c5c77ad9-bdc5-45f6-9d13-7779586312c2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:14.978754 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-c5c77ad9-bdc5-45f6-9d13-7779586312c2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:14.986805 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-c5c77ad9-bdc5-45f6-9d13-7779586312c2 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1674 microversion: 2.1 time: 0.158318 Sep 09 23:28:14.987382 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 416/810] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:14 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:28:15.125420 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-65ce179e-bafc-4a74-a1ce-35c23746d524 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:15.126322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-65ce179e-bafc-4a74-a1ce-35c23746d524 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:15.132991 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65ce179e-bafc-4a74-a1ce-35c23746d524 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:15.133616 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65ce179e-bafc-4a74-a1ce-35c23746d524 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:15.134056 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65ce179e-bafc-4a74-a1ce-35c23746d524 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:15.134785 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65ce179e-bafc-4a74-a1ce-35c23746d524 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:15.135230 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65ce179e-bafc-4a74-a1ce-35c23746d524 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:15.135648 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65ce179e-bafc-4a74-a1ce-35c23746d524 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:15.393576 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3cbf7019-c243-448b-b714-26fc43e8e05c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-367975644"}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:28:15.394394 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3cbf7019-c243-448b-b714-26fc43e8e05c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:15.408101 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cbf7019-c243-448b-b714-26fc43e8e05c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:15.408600 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cbf7019-c243-448b-b714-26fc43e8e05c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:15.409035 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cbf7019-c243-448b-b714-26fc43e8e05c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:15.409747 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cbf7019-c243-448b-b714-26fc43e8e05c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:15.410203 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cbf7019-c243-448b-b714-26fc43e8e05c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:15.410664 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cbf7019-c243-448b-b714-26fc43e8e05c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:15.502312 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-65ce179e-bafc-4a74-a1ce-35c23746d524 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:15.511007 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-65ce179e-bafc-4a74-a1ce-35c23746d524 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:15.512538 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-65ce179e-bafc-4a74-a1ce-35c23746d524 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:15.513912 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-65ce179e-bafc-4a74-a1ce-35c23746d524 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.392679 Sep 09 23:28:15.514534 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 395/811] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:15 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:15.600478 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.network.security_group_api [None req-3cbf7019-c243-448b-b714-26fc43e8e05c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Removing security group e884058c-47be-4936-bae8-bb8939863864 from port d8801e29-936f-4850-b8b8-729b8370c4bc Sep 09 23:28:16.011852 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ffb2bb8c-8d15-4cf4-bf1f-d55ab91a7473 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:16.012476 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ffb2bb8c-8d15-4cf4-bf1f-d55ab91a7473 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:16.018526 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ffb2bb8c-8d15-4cf4-bf1f-d55ab91a7473 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:16.019207 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ffb2bb8c-8d15-4cf4-bf1f-d55ab91a7473 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:16.019673 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ffb2bb8c-8d15-4cf4-bf1f-d55ab91a7473 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:16.020612 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ffb2bb8c-8d15-4cf4-bf1f-d55ab91a7473 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:16.021513 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ffb2bb8c-8d15-4cf4-bf1f-d55ab91a7473 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:16.023850 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ffb2bb8c-8d15-4cf4-bf1f-d55ab91a7473 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:16.039064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3cbf7019-c243-448b-b714-26fc43e8e05c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "POST /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/action" status: 202 len: 0 microversion: 2.1 time: 0.647290 Sep 09 23:28:16.050055 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 417/812] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 23:28:15 2022] POST /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 23:28:16.060216 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-b0621380-d8bc-4ed6-8763-e17b726e42d7 req-34e0f7fc-9b17-47b5-b082-59f68f9cf185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072aebfe-bdb3-47e7-9b55-deddc8c248e9", "tag": "d8801e29-936f-4850-b8b8-729b8370c4bc"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:28:16.089692 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-b0621380-d8bc-4ed6-8763-e17b726e42d7 req-34e0f7fc-9b17-47b5-b082-59f68f9cf185 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:16.091045 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-b0621380-d8bc-4ed6-8763-e17b726e42d7 req-34e0f7fc-9b17-47b5-b082-59f68f9cf185 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:16.091700 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-b0621380-d8bc-4ed6-8763-e17b726e42d7 req-34e0f7fc-9b17-47b5-b082-59f68f9cf185 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:16.107510 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-b0621380-d8bc-4ed6-8763-e17b726e42d7 req-34e0f7fc-9b17-47b5-b082-59f68f9cf185 service nova] Creating event network-changed:d8801e29-936f-4850-b8b8-729b8370c4bc for instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 on hv-cinder-85032 Sep 09 23:28:16.113997 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-b0621380-d8bc-4ed6-8763-e17b726e42d7 req-34e0f7fc-9b17-47b5-b082-59f68f9cf185 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062025 Sep 09 23:28:16.115198 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 418/813] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:28:16.276791 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ffb2bb8c-8d15-4cf4-bf1f-d55ab91a7473 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:16.290886 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ffb2bb8c-8d15-4cf4-bf1f-d55ab91a7473 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1674 microversion: 2.1 time: 0.281071 Sep 09 23:28:16.290886 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 396/814] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:16 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1674 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:28:16.540892 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b9f026b2-6e1b-4a5e-9d2d-f1388594f8b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:16.541588 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b9f026b2-6e1b-4a5e-9d2d-f1388594f8b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:16.550661 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b9f026b2-6e1b-4a5e-9d2d-f1388594f8b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:16.551455 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b9f026b2-6e1b-4a5e-9d2d-f1388594f8b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:16.551894 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b9f026b2-6e1b-4a5e-9d2d-f1388594f8b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:16.552782 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b9f026b2-6e1b-4a5e-9d2d-f1388594f8b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:16.553419 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b9f026b2-6e1b-4a5e-9d2d-f1388594f8b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:16.553891 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b9f026b2-6e1b-4a5e-9d2d-f1388594f8b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:16.768268 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b9f026b2-6e1b-4a5e-9d2d-f1388594f8b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:16.784038 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b9f026b2-6e1b-4a5e-9d2d-f1388594f8b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:16.785492 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b9f026b2-6e1b-4a5e-9d2d-f1388594f8b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:16.786681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b9f026b2-6e1b-4a5e-9d2d-f1388594f8b9 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.250718 Sep 09 23:28:16.802066 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 419/815] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:16 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:17.316334 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-d8489544-996b-4cc1-9845-cb548fd697f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:17.317171 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-d8489544-996b-4cc1-9845-cb548fd697f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:17.332536 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d8489544-996b-4cc1-9845-cb548fd697f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:17.332536 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d8489544-996b-4cc1-9845-cb548fd697f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:17.332536 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d8489544-996b-4cc1-9845-cb548fd697f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:17.332536 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d8489544-996b-4cc1-9845-cb548fd697f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:17.333046 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d8489544-996b-4cc1-9845-cb548fd697f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:17.333046 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d8489544-996b-4cc1-9845-cb548fd697f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:17.631805 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d8489544-996b-4cc1-9845-cb548fd697f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:17.639911 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-d8489544-996b-4cc1-9845-cb548fd697f9 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1674 microversion: 2.1 time: 0.327361 Sep 09 23:28:17.640622 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 397/816] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:17 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1674 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:28:17.765002 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-1146ef2e-1a7e-4cf5-b706-2eb0ef16b122 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:17.765564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-1146ef2e-1a7e-4cf5-b706-2eb0ef16b122 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:17.775977 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1146ef2e-1a7e-4cf5-b706-2eb0ef16b122 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:17.776468 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1146ef2e-1a7e-4cf5-b706-2eb0ef16b122 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:17.776900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1146ef2e-1a7e-4cf5-b706-2eb0ef16b122 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:17.781386 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1146ef2e-1a7e-4cf5-b706-2eb0ef16b122 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:17.782606 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1146ef2e-1a7e-4cf5-b706-2eb0ef16b122 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:17.783246 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-1146ef2e-1a7e-4cf5-b706-2eb0ef16b122 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:17.813409 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-bd96de22-4f69-47cd-bddc-3fa74c848b0c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:17.814113 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-bd96de22-4f69-47cd-bddc-3fa74c848b0c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:17.821679 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bd96de22-4f69-47cd-bddc-3fa74c848b0c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:17.824628 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bd96de22-4f69-47cd-bddc-3fa74c848b0c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:17.825148 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bd96de22-4f69-47cd-bddc-3fa74c848b0c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:17.826677 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bd96de22-4f69-47cd-bddc-3fa74c848b0c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:17.828445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bd96de22-4f69-47cd-bddc-3fa74c848b0c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:17.828955 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bd96de22-4f69-47cd-bddc-3fa74c848b0c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:17.951172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-1146ef2e-1a7e-4cf5-b706-2eb0ef16b122 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lazy-loading 'services' on Instance uuid 072aebfe-bdb3-47e7-9b55-deddc8c248e9 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:28:18.136142 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bd96de22-4f69-47cd-bddc-3fa74c848b0c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:18.145822 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bd96de22-4f69-47cd-bddc-3fa74c848b0c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:18.148074 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bd96de22-4f69-47cd-bddc-3fa74c848b0c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:18.149542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-bd96de22-4f69-47cd-bddc-3fa74c848b0c tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1743 microversion: 2.20 time: 0.340081 Sep 09 23:28:18.151731 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 398/817] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:17 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1743 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:28:18.156655 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-a9f35b83-ec3a-4daf-9d90-cb8295b81c19 req-61339b3a-3b6d-4356-9aa7-97f5be1bc1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072aebfe-bdb3-47e7-9b55-deddc8c248e9", "tag": "d8801e29-936f-4850-b8b8-729b8370c4bc"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:28:18.169746 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-a9f35b83-ec3a-4daf-9d90-cb8295b81c19 req-61339b3a-3b6d-4356-9aa7-97f5be1bc1b6 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:18.170578 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-a9f35b83-ec3a-4daf-9d90-cb8295b81c19 req-61339b3a-3b6d-4356-9aa7-97f5be1bc1b6 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:18.171723 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-a9f35b83-ec3a-4daf-9d90-cb8295b81c19 req-61339b3a-3b6d-4356-9aa7-97f5be1bc1b6 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:18.202549 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-1146ef2e-1a7e-4cf5-b706-2eb0ef16b122 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/os-volume_attachments/348d5f71-950c-4545-b610-27c18a0df60e" status: 202 len: 0 microversion: 2.1 time: 0.435185 Sep 09 23:28:18.202549 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 420/818] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 23:28:17 2022] DELETE /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/os-volume_attachments/348d5f71-950c-4545-b610-27c18a0df60e => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:28:18.221774 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-a9f35b83-ec3a-4daf-9d90-cb8295b81c19 req-61339b3a-3b6d-4356-9aa7-97f5be1bc1b6 service nova] Creating event network-changed:d8801e29-936f-4850-b8b8-729b8370c4bc for instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 on hv-cinder-85032 Sep 09 23:28:18.224370 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7833cdca-7682-4262-836a-2b2cdde37019 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:18.233898 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-a9f35b83-ec3a-4daf-9d90-cb8295b81c19 req-61339b3a-3b6d-4356-9aa7-97f5be1bc1b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080622 Sep 09 23:28:18.234515 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 399/819] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:28:18.235078 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7833cdca-7682-4262-836a-2b2cdde37019 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:18.245190 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7833cdca-7682-4262-836a-2b2cdde37019 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:18.246013 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7833cdca-7682-4262-836a-2b2cdde37019 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:18.246665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7833cdca-7682-4262-836a-2b2cdde37019 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:18.248408 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7833cdca-7682-4262-836a-2b2cdde37019 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:18.249094 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7833cdca-7682-4262-836a-2b2cdde37019 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:18.249774 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7833cdca-7682-4262-836a-2b2cdde37019 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:18.297085 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7833cdca-7682-4262-836a-2b2cdde37019 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088060 Sep 09 23:28:18.300762 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 421/820] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:28:18 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:28:18.427479 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-4e8731dc-9cbb-42ab-9f35-5ac03635e01f req-e73debeb-4bb6-4bc9-92bf-a1a9aaad14d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026e4485-df9d-411d-98da-db2109bcf03b", "name": "network-vif-deleted", "tag": "0780d6cc-ab17-42a7-894c-8eff61ba4eab"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:28:18.452827 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-4e8731dc-9cbb-42ab-9f35-5ac03635e01f req-e73debeb-4bb6-4bc9-92bf-a1a9aaad14d5 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:18.453098 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-4e8731dc-9cbb-42ab-9f35-5ac03635e01f req-e73debeb-4bb6-4bc9-92bf-a1a9aaad14d5 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:18.458629 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-4e8731dc-9cbb-42ab-9f35-5ac03635e01f req-e73debeb-4bb6-4bc9-92bf-a1a9aaad14d5 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:18.485030 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-4e8731dc-9cbb-42ab-9f35-5ac03635e01f req-e73debeb-4bb6-4bc9-92bf-a1a9aaad14d5 service nova] Creating event network-vif-deleted:0780d6cc-ab17-42a7-894c-8eff61ba4eab for instance 026e4485-df9d-411d-98da-db2109bcf03b on hv-cinder-85032 Sep 09 23:28:18.495172 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-4e8731dc-9cbb-42ab-9f35-5ac03635e01f req-e73debeb-4bb6-4bc9-92bf-a1a9aaad14d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075330 Sep 09 23:28:18.496203 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 400/821] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:28:18.665255 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-08dde260-daaa-4ff8-8dfc-b5c3b5fc2619 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:18.665820 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-08dde260-daaa-4ff8-8dfc-b5c3b5fc2619 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:18.674094 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08dde260-daaa-4ff8-8dfc-b5c3b5fc2619 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:18.674619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08dde260-daaa-4ff8-8dfc-b5c3b5fc2619 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:18.675691 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08dde260-daaa-4ff8-8dfc-b5c3b5fc2619 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:18.675822 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08dde260-daaa-4ff8-8dfc-b5c3b5fc2619 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:18.676224 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08dde260-daaa-4ff8-8dfc-b5c3b5fc2619 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:18.676656 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08dde260-daaa-4ff8-8dfc-b5c3b5fc2619 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:18.755292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-08dde260-daaa-4ff8-8dfc-b5c3b5fc2619 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:18.764148 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-08dde260-daaa-4ff8-8dfc-b5c3b5fc2619 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1607 microversion: 2.1 time: 0.103319 Sep 09 23:28:18.765658 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 422/822] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:18 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1607 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:28:19.182008 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3f98a1bb-a3b4-4c2e-9839-7e6af91168e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:19.183536 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3f98a1bb-a3b4-4c2e-9839-7e6af91168e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:19.197724 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3f98a1bb-a3b4-4c2e-9839-7e6af91168e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:19.198226 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3f98a1bb-a3b4-4c2e-9839-7e6af91168e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:19.198696 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3f98a1bb-a3b4-4c2e-9839-7e6af91168e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:19.200475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3f98a1bb-a3b4-4c2e-9839-7e6af91168e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:19.207250 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3f98a1bb-a3b4-4c2e-9839-7e6af91168e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:19.208165 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3f98a1bb-a3b4-4c2e-9839-7e6af91168e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:19.313505 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4b63ccb3-d927-4c42-807a-abdbbf6eff1c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:19.322013 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4b63ccb3-d927-4c42-807a-abdbbf6eff1c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:19.369586 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4b63ccb3-d927-4c42-807a-abdbbf6eff1c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:19.371867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4b63ccb3-d927-4c42-807a-abdbbf6eff1c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:19.374631 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4b63ccb3-d927-4c42-807a-abdbbf6eff1c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:19.379553 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4b63ccb3-d927-4c42-807a-abdbbf6eff1c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:19.380064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4b63ccb3-d927-4c42-807a-abdbbf6eff1c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:19.380513 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4b63ccb3-d927-4c42-807a-abdbbf6eff1c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:19.483894 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4b63ccb3-d927-4c42-807a-abdbbf6eff1c tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174247 Sep 09 23:28:19.486958 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 423/823] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:28:19 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:28:19.693175 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3f98a1bb-a3b4-4c2e-9839-7e6af91168e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:19.706976 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3f98a1bb-a3b4-4c2e-9839-7e6af91168e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:19.708517 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3f98a1bb-a3b4-4c2e-9839-7e6af91168e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:19.719048 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3f98a1bb-a3b4-4c2e-9839-7e6af91168e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1738 microversion: 2.20 time: 0.543701 Sep 09 23:28:19.734064 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 401/824] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:19 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1738 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:19.790413 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-886d2370-b773-4b78-bd0c-e3d4487fdc27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:19.791176 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-886d2370-b773-4b78-bd0c-e3d4487fdc27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:19.797407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-886d2370-b773-4b78-bd0c-e3d4487fdc27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:19.798416 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-886d2370-b773-4b78-bd0c-e3d4487fdc27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:19.799091 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-886d2370-b773-4b78-bd0c-e3d4487fdc27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:19.800037 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-886d2370-b773-4b78-bd0c-e3d4487fdc27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:19.800602 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-886d2370-b773-4b78-bd0c-e3d4487fdc27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:19.801235 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-886d2370-b773-4b78-bd0c-e3d4487fdc27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:19.851304 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-886d2370-b773-4b78-bd0c-e3d4487fdc27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:19.851898 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-886d2370-b773-4b78-bd0c-e3d4487fdc27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:19.852410 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-886d2370-b773-4b78-bd0c-e3d4487fdc27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:19.852943 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-886d2370-b773-4b78-bd0c-e3d4487fdc27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lazy-loading 'fault' on Instance uuid 026e4485-df9d-411d-98da-db2109bcf03b {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:28:19.913928 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-886d2370-b773-4b78-bd0c-e3d4487fdc27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f097c4fc270748cc8d41d7bcaba672a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3517b03576446a902816ab0bbff2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:19.924068 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-886d2370-b773-4b78-bd0c-e3d4487fdc27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 200 len: 1328 microversion: 2.1 time: 0.136636 Sep 09 23:28:19.924068 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 424/825] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:19 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 1328 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:28:20.504891 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-86b463b3-64ab-4816-835e-3b24556ac918 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:20.510244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-86b463b3-64ab-4816-835e-3b24556ac918 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:20.534067 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-86b463b3-64ab-4816-835e-3b24556ac918 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:20.534597 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-86b463b3-64ab-4816-835e-3b24556ac918 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:20.535033 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-86b463b3-64ab-4816-835e-3b24556ac918 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:20.536028 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-86b463b3-64ab-4816-835e-3b24556ac918 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:20.536478 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-86b463b3-64ab-4816-835e-3b24556ac918 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:20.536908 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-86b463b3-64ab-4816-835e-3b24556ac918 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:20.577255 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-86b463b3-64ab-4816-835e-3b24556ac918 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077760 Sep 09 23:28:20.577842 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 402/826] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:28:20 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:28:20.594087 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-2a2e87a8-ecba-4515-9b64-930c37f9941e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:20.595007 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-2a2e87a8-ecba-4515-9b64-930c37f9941e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:20.602605 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2a2e87a8-ecba-4515-9b64-930c37f9941e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:20.603324 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2a2e87a8-ecba-4515-9b64-930c37f9941e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:20.603944 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2a2e87a8-ecba-4515-9b64-930c37f9941e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:20.604816 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2a2e87a8-ecba-4515-9b64-930c37f9941e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:20.605461 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2a2e87a8-ecba-4515-9b64-930c37f9941e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:20.605926 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2a2e87a8-ecba-4515-9b64-930c37f9941e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:20.700499 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-2a2e87a8-ecba-4515-9b64-930c37f9941e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] HTTP exception thrown: Instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 is not attached to volume 348d5f71-950c-4545-b610-27c18a0df60e Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-2a2e87a8-ecba-4515-9b64-930c37f9941e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Request method failure captured: Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: DELETE /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/os-volume_attachments/348d5f71-950c-4545-b610-27c18a0df60e HTTP/1.1 Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8t2AC80OFE1jndiwbqzzi8Mvg_adPoH4Gc0N49QYpufZaH7AQfJHblL8FFfLwPsH5QykCxCQAoPh6v_tX1Q9YcUzLyKfgPg5FVF_slrZlo9J0IuYi7EhgqafrrexpGCc5MI3-ZdUZrRo3w7BvUdKzA5zKKMWgu-P97_hVENGhDKNuE Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 28d0bb1d968841c2986b5eb164af953b Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-TestMinimumBasicScenario-1771998118 Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:28:20.703529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:28:20.705160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28d0bb1d968841c2986b5eb164af953b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28d0bb1d968841c2986b5eb164af953b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28d0bb1d968841c2986b5eb164af953b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28d0bb1d968841c2986b5eb164af953b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:28:20.705160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-TestMinimumBasicScenario-1771998118 Sep 09 23:28:20.705160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 28d0bb1d968841c2986b5eb164af953b Sep 09 23:28:20.705160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1771998118 Sep 09 23:28:20.705160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-TestMinimumBasicScenario-1771998118-project Sep 09 23:28:20.705160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:28:20.705160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:28:20.705160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: c4129e5f14794a619acdaf5c56a02cb8 Sep 09 23:28:20.705160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-TestMinimumBasicScenario-1771998118-project Sep 09 23:28:20.705160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:28:20.705160 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 is not attached to volume 348d5f71-950c-4545-b610-27c18a0df60e Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'server_id': '072aebfe-bdb3-47e7-9b55-deddc8c248e9', 'id': '348d5f71-950c-4545-b610-27c18a0df60e'} Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 348d5f71-950c-4545-b610-27c18a0df60e. Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:28:20.706025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:28:20.707503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:28:20.707503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 09 23:28:20.707503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 09 23:28:20.707503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 is not attached to volume 348d5f71-950c-4545-b610-27c18a0df60e Sep 09 23:28:20.707503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:20.707503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:28:20.707503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:20.707503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:20.707503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:28:20.707503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:28:20.707503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:28:20.707503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:28:20.707503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 is not attached to volume 348d5f71-950c-4545-b610-27c18a0df60e Sep 09 23:28:20.707503 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:20.709958 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-2a2e87a8-ecba-4515-9b64-930c37f9941e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Returning 404 to user: Instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 is not attached to volume 348d5f71-950c-4545-b610-27c18a0df60e {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:28:20.711078 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-2a2e87a8-ecba-4515-9b64-930c37f9941e tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/os-volume_attachments/348d5f71-950c-4545-b610-27c18a0df60e" status: 404 len: 154 microversion: 2.1 time: 0.121109 Sep 09 23:28:20.711864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 425/827] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 23:28:20 2022] DELETE /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9/os-volume_attachments/348d5f71-950c-4545-b610-27c18a0df60e => generated 154 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:28:20.750385 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-759d98b0-f4f5-4be1-aeca-c822a9aa1f40 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:20.751626 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-759d98b0-f4f5-4be1-aeca-c822a9aa1f40 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:20.763455 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-759d98b0-f4f5-4be1-aeca-c822a9aa1f40 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:20.763848 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-759d98b0-f4f5-4be1-aeca-c822a9aa1f40 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:20.764299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-759d98b0-f4f5-4be1-aeca-c822a9aa1f40 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:20.765085 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-759d98b0-f4f5-4be1-aeca-c822a9aa1f40 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:20.765552 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-759d98b0-f4f5-4be1-aeca-c822a9aa1f40 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:20.765980 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-759d98b0-f4f5-4be1-aeca-c822a9aa1f40 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:20.949856 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-92a171f6-2182-4610-8426-c3e9cc6ef9b3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:20.950591 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-92a171f6-2182-4610-8426-c3e9cc6ef9b3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:20.951048 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-759d98b0-f4f5-4be1-aeca-c822a9aa1f40 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:20.957853 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-92a171f6-2182-4610-8426-c3e9cc6ef9b3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:20.958804 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-92a171f6-2182-4610-8426-c3e9cc6ef9b3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:20.960378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-92a171f6-2182-4610-8426-c3e9cc6ef9b3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:20.961424 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-92a171f6-2182-4610-8426-c3e9cc6ef9b3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:20.962110 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-92a171f6-2182-4610-8426-c3e9cc6ef9b3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:20.962730 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-92a171f6-2182-4610-8426-c3e9cc6ef9b3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:20.978248 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-759d98b0-f4f5-4be1-aeca-c822a9aa1f40 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:20.980027 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-759d98b0-f4f5-4be1-aeca-c822a9aa1f40 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:20.981263 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-759d98b0-f4f5-4be1-aeca-c822a9aa1f40 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1738 microversion: 2.20 time: 0.236950 Sep 09 23:28:20.991329 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 403/828] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:20 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:21.000755 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-92a171f6-2182-4610-8426-c3e9cc6ef9b3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] HTTP exception thrown: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-92a171f6-2182-4610-8426-c3e9cc6ef9b3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Request method failure captured: Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b HTTP/1.1 Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8pwuR6kqc7k0stDLKdFO4Ckk0gymyfMjIdGenSRMfvp5f3MJkij-SA0jpro4oueYSNQT201tvFKNLp_zoiAVeIBUcez9Cupz75IOKVWJp9SMAptEU2dx_Fm6ZH14If3_21qeS5XMAwu28pXoKNydVEVNi9I0hMe3b6lKrxXSIdkEpg Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 5c3517b03576446a902816ab0bbff2e7 Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:28:21.005560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:28:21.007867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c3517b03576446a902816ab0bbff2e7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:28:21.007867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:28:21.007867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 5c3517b03576446a902816ab0bbff2e7 Sep 09 23:28:21.007867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:28:21.007867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeTestJSON-1262781169-project Sep 09 23:28:21.007867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:28:21.007867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:28:21.007867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: f097c4fc270748cc8d41d7bcaba672a7 Sep 09 23:28:21.007867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeTestJSON-1262781169-project Sep 09 23:28:21.007867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:28:21.007867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. Sep 09 23:28:21.007867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '026e4485-df9d-411d-98da-db2109bcf03b'} Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:28:21.008757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. Sep 09 23:28:21.010107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:21.011303 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-92a171f6-2182-4610-8426-c3e9cc6ef9b3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Returning 404 to user: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:28:21.011303 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-92a171f6-2182-4610-8426-c3e9cc6ef9b3 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 404 len: 111 microversion: 2.1 time: 0.066790 Sep 09 23:28:21.011303 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 426/829] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:20 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:28:21.018558 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c3c9fceb-2405-4e0b-b03f-5015cdcf9b27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '.version_select at 0x7f908dc79550>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:21.240877 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c3c9fceb-2405-4e0b-b03f-5015cdcf9b27 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585560311" status: 202 len: 0 microversion: 2.1 time: 0.225177 Sep 09 23:28:21.242080 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 404/830] 10.222.0.20 () {58 vars in 1221 bytes} [Fri Sep 9 23:28:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585560311 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:28:21.256999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-5ca9c7df-b3b4-4447-b55f-ba9caccdebfc req-0861b007-68b6-40e1-b8a7-5ed90981a9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a008236c-707a-4578-912c-07adedbb10cb", "name": "network-vif-plugged", "status": "completed", "tag": "b8c3dd2c-6785-40c3-87d8-e3d4dae738c5"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:28:21.272155 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-5ca9c7df-b3b4-4447-b55f-ba9caccdebfc req-0861b007-68b6-40e1-b8a7-5ed90981a9e7 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:21.274937 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-5ca9c7df-b3b4-4447-b55f-ba9caccdebfc req-0861b007-68b6-40e1-b8a7-5ed90981a9e7 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:21.275639 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-5ca9c7df-b3b4-4447-b55f-ba9caccdebfc req-0861b007-68b6-40e1-b8a7-5ed90981a9e7 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:21.292066 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-5ca9c7df-b3b4-4447-b55f-ba9caccdebfc req-0861b007-68b6-40e1-b8a7-5ed90981a9e7 service nova] Creating event network-vif-plugged:b8c3dd2c-6785-40c3-87d8-e3d4dae738c5 for instance a008236c-707a-4578-912c-07adedbb10cb on hv-cinder-85032 Sep 09 23:28:21.303724 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-5ca9c7df-b3b4-4447-b55f-ba9caccdebfc req-0861b007-68b6-40e1-b8a7-5ed90981a9e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046981 Sep 09 23:28:21.305092 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 427/831] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:28:22.012285 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-65328ea7-9d49-4dd3-a289-27eb56528ef7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:22.012896 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-65328ea7-9d49-4dd3-a289-27eb56528ef7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:22.019413 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65328ea7-9d49-4dd3-a289-27eb56528ef7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:22.020240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65328ea7-9d49-4dd3-a289-27eb56528ef7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:22.020876 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65328ea7-9d49-4dd3-a289-27eb56528ef7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:22.022200 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65328ea7-9d49-4dd3-a289-27eb56528ef7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:22.022926 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65328ea7-9d49-4dd3-a289-27eb56528ef7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:22.023561 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65328ea7-9d49-4dd3-a289-27eb56528ef7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:22.094981 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-88277af8-203b-4f54-ae47-db2dddd9f2f2 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:22.096300 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-88277af8-203b-4f54-ae47-db2dddd9f2f2 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:22.104287 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-88277af8-203b-4f54-ae47-db2dddd9f2f2 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:22.105039 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-88277af8-203b-4f54-ae47-db2dddd9f2f2 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:22.105646 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-88277af8-203b-4f54-ae47-db2dddd9f2f2 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:22.106647 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-88277af8-203b-4f54-ae47-db2dddd9f2f2 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:22.107254 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-88277af8-203b-4f54-ae47-db2dddd9f2f2 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:22.107846 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-88277af8-203b-4f54-ae47-db2dddd9f2f2 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:22.143919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-88277af8-203b-4f54-ae47-db2dddd9f2f2 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Going to try to terminate instance {{(pid=121059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:28:22.236389 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-65328ea7-9d49-4dd3-a289-27eb56528ef7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:22.246283 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-65328ea7-9d49-4dd3-a289-27eb56528ef7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:22.247941 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-65328ea7-9d49-4dd3-a289-27eb56528ef7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:22.249382 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-65328ea7-9d49-4dd3-a289-27eb56528ef7 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1738 microversion: 2.20 time: 0.241579 Sep 09 23:28:22.267158 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 405/832] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:22 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:22.438037 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-88277af8-203b-4f54-ae47-db2dddd9f2f2 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 204 len: 0 microversion: 2.1 time: 0.348099 Sep 09 23:28:22.446935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 428/833] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:28:22 2022] DELETE /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:28:22.447959 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-82296a91-365b-45f5-81b1-ff6fe1bb83cf tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:22.448531 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-82296a91-365b-45f5-81b1-ff6fe1bb83cf tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:22.458644 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-82296a91-365b-45f5-81b1-ff6fe1bb83cf tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:22.460218 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-82296a91-365b-45f5-81b1-ff6fe1bb83cf tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:22.460934 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-82296a91-365b-45f5-81b1-ff6fe1bb83cf tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:22.461825 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-82296a91-365b-45f5-81b1-ff6fe1bb83cf tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:22.462499 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-82296a91-365b-45f5-81b1-ff6fe1bb83cf tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:22.463079 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-82296a91-365b-45f5-81b1-ff6fe1bb83cf tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:22.696737 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-82296a91-365b-45f5-81b1-ff6fe1bb83cf tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:22.705272 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-82296a91-365b-45f5-81b1-ff6fe1bb83cf tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1553 microversion: 2.1 time: 0.261429 Sep 09 23:28:22.706111 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 406/834] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:22 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:28:23.281630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-2b66b402-3955-4b40-8d34-c54233b73946 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:23.283292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-2b66b402-3955-4b40-8d34-c54233b73946 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:23.285561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:28:23.292249 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b66b402-3955-4b40-8d34-c54233b73946 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:23.293185 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b66b402-3955-4b40-8d34-c54233b73946 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:23.293851 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b66b402-3955-4b40-8d34-c54233b73946 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:23.295317 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b66b402-3955-4b40-8d34-c54233b73946 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:23.296023 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b66b402-3955-4b40-8d34-c54233b73946 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:23.296868 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2b66b402-3955-4b40-8d34-c54233b73946 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:23.506682 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-2b66b402-3955-4b40-8d34-c54233b73946 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:23.515673 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-2b66b402-3955-4b40-8d34-c54233b73946 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:23.517060 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-2b66b402-3955-4b40-8d34-c54233b73946 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:23.518887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-2b66b402-3955-4b40-8d34-c54233b73946 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1738 microversion: 2.20 time: 0.244009 Sep 09 23:28:23.519548 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 429/835] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:23 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:23.728993 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-45b7e8e4-a172-4fac-8640-318eeeaac7fc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:23.729637 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-45b7e8e4-a172-4fac-8640-318eeeaac7fc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:23.736959 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-45b7e8e4-a172-4fac-8640-318eeeaac7fc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:23.737467 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-45b7e8e4-a172-4fac-8640-318eeeaac7fc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:23.737889 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-45b7e8e4-a172-4fac-8640-318eeeaac7fc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:23.738623 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-45b7e8e4-a172-4fac-8640-318eeeaac7fc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:23.739082 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-45b7e8e4-a172-4fac-8640-318eeeaac7fc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:23.739508 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-45b7e8e4-a172-4fac-8640-318eeeaac7fc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:23.872799 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-45b7e8e4-a172-4fac-8640-318eeeaac7fc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:23.880464 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-45b7e8e4-a172-4fac-8640-318eeeaac7fc tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1553 microversion: 2.1 time: 0.155367 Sep 09 23:28:23.881653 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 407/836] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:23 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:28:24.545614 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e51b45b6-69c4-4a3f-bdb4-5e9863807b14 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:24.546227 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e51b45b6-69c4-4a3f-bdb4-5e9863807b14 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:24.554884 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e51b45b6-69c4-4a3f-bdb4-5e9863807b14 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:24.567965 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e51b45b6-69c4-4a3f-bdb4-5e9863807b14 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:24.567965 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e51b45b6-69c4-4a3f-bdb4-5e9863807b14 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:24.567965 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e51b45b6-69c4-4a3f-bdb4-5e9863807b14 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:24.567965 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e51b45b6-69c4-4a3f-bdb4-5e9863807b14 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:24.568457 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e51b45b6-69c4-4a3f-bdb4-5e9863807b14 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:24.861524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e51b45b6-69c4-4a3f-bdb4-5e9863807b14 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:24.875301 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e51b45b6-69c4-4a3f-bdb4-5e9863807b14 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:24.878735 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e51b45b6-69c4-4a3f-bdb4-5e9863807b14 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:24.881728 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e51b45b6-69c4-4a3f-bdb4-5e9863807b14 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1738 microversion: 2.20 time: 0.339672 Sep 09 23:28:24.894579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 430/837] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:24 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1738 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:24.909067 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-65e0d7b6-23e1-4e0d-9a87-3d23ede04409 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:24.911848 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-65e0d7b6-23e1-4e0d-9a87-3d23ede04409 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:24.917113 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65e0d7b6-23e1-4e0d-9a87-3d23ede04409 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:24.917820 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65e0d7b6-23e1-4e0d-9a87-3d23ede04409 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:24.918443 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65e0d7b6-23e1-4e0d-9a87-3d23ede04409 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:24.919315 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65e0d7b6-23e1-4e0d-9a87-3d23ede04409 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:24.919765 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65e0d7b6-23e1-4e0d-9a87-3d23ede04409 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:24.920384 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65e0d7b6-23e1-4e0d-9a87-3d23ede04409 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:25.094400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-65e0d7b6-23e1-4e0d-9a87-3d23ede04409 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:25.106848 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-65e0d7b6-23e1-4e0d-9a87-3d23ede04409 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1553 microversion: 2.1 time: 0.201355 Sep 09 23:28:25.108109 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 408/838] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:24 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:28:25.228925 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-56165983-1811-42fd-a41c-4363cdf2118a req-0d63f2ec-45a6-472f-afe2-081cb0cd4564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072aebfe-bdb3-47e7-9b55-deddc8c248e9", "name": "network-vif-deleted", "tag": "d8801e29-936f-4850-b8b8-729b8370c4bc"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:28:25.240024 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-56165983-1811-42fd-a41c-4363cdf2118a req-0d63f2ec-45a6-472f-afe2-081cb0cd4564 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:25.240670 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-56165983-1811-42fd-a41c-4363cdf2118a req-0d63f2ec-45a6-472f-afe2-081cb0cd4564 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:25.241109 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-56165983-1811-42fd-a41c-4363cdf2118a req-0d63f2ec-45a6-472f-afe2-081cb0cd4564 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:25.253695 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-56165983-1811-42fd-a41c-4363cdf2118a req-0d63f2ec-45a6-472f-afe2-081cb0cd4564 service nova] Creating event network-vif-deleted:d8801e29-936f-4850-b8b8-729b8370c4bc for instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 on hv-cinder-85032 Sep 09 23:28:25.259881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-56165983-1811-42fd-a41c-4363cdf2118a req-0d63f2ec-45a6-472f-afe2-081cb0cd4564 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035373 Sep 09 23:28:25.267300 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 431/839] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:28:25.676712 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-56bb709c-2e07-4c80-99ae-a3978179960e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:25.677232 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-56bb709c-2e07-4c80-99ae-a3978179960e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:25.686532 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56bb709c-2e07-4c80-99ae-a3978179960e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:25.687496 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56bb709c-2e07-4c80-99ae-a3978179960e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:25.687944 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56bb709c-2e07-4c80-99ae-a3978179960e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:25.688662 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56bb709c-2e07-4c80-99ae-a3978179960e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:25.689123 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56bb709c-2e07-4c80-99ae-a3978179960e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:25.689550 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56bb709c-2e07-4c80-99ae-a3978179960e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:25.720110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-56bb709c-2e07-4c80-99ae-a3978179960e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] HTTP exception thrown: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-56bb709c-2e07-4c80-99ae-a3978179960e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Request method failure captured: Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: DELETE /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b HTTP/1.1 Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8pwuR6kqc7k0stDLKdFO4Ckk0gymyfMjIdGenSRMfvp5f3MJkij-SA0jpro4oueYSNQT201tvFKNLp_zoiAVeIBUcez9Cupz75IOKVWJp9SMAptEU2dx_Fm6ZH14If3_21qeS5XMAwu28pXoKNydVEVNi9I0hMe3b6lKrxXSIdkEpg Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 5c3517b03576446a902816ab0bbff2e7 Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:28:25.722717 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:28:25.724447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c3517b03576446a902816ab0bbff2e7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:28:25.724447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:28:25.724447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 5c3517b03576446a902816ab0bbff2e7 Sep 09 23:28:25.724447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:28:25.724447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-AttachVolumeTestJSON-1262781169-project Sep 09 23:28:25.724447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:28:25.724447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:28:25.724447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: f097c4fc270748cc8d41d7bcaba672a7 Sep 09 23:28:25.724447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-AttachVolumeTestJSON-1262781169-project Sep 09 23:28:25.724447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:28:25.724447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. Sep 09 23:28:25.724447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '026e4485-df9d-411d-98da-db2109bcf03b'} Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:28:25.726525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. Sep 09 23:28:25.728151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:28:25.729661 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-56bb709c-2e07-4c80-99ae-a3978179960e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Returning 404 to user: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:28:25.729661 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-56bb709c-2e07-4c80-99ae-a3978179960e tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "DELETE /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 404 len: 111 microversion: 2.1 time: 0.051516 Sep 09 23:28:25.735318 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fb0818df-0971-463a-a6f0-e13d96e5c23d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:25.736030 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-fb0818df-0971-463a-a6f0-e13d96e5c23d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: 026e4485-df9d-411d-98da-db2109bcf03b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:25.739250 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 409/840] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:28:25 2022] DELETE /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:28:25.742716 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb0818df-0971-463a-a6f0-e13d96e5c23d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:25.743215 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb0818df-0971-463a-a6f0-e13d96e5c23d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:25.743651 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb0818df-0971-463a-a6f0-e13d96e5c23d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:25.744732 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb0818df-0971-463a-a6f0-e13d96e5c23d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:25.745368 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb0818df-0971-463a-a6f0-e13d96e5c23d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:25.745982 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb0818df-0971-463a-a6f0-e13d96e5c23d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:25.750951 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:28:25.762657 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-fb0818df-0971-463a-a6f0-e13d96e5c23d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] HTTP exception thrown: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fb0818df-0971-463a-a6f0-e13d96e5c23d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Request method failure captured: Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b HTTP/1.1 Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8pwuR6kqc7k0stDLKdFO4Ckk0gymyfMjIdGenSRMfvp5f3MJkij-SA0jpro4oueYSNQT201tvFKNLp_zoiAVeIBUcez9Cupz75IOKVWJp9SMAptEU2dx_Fm6ZH14If3_21qeS5XMAwu28pXoKNydVEVNi9I0hMe3b6lKrxXSIdkEpg Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 5c3517b03576446a902816ab0bbff2e7 Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:28:25.764803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:28:25.770285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c3517b03576446a902816ab0bbff2e7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:28:25.770285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:28:25.770285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 5c3517b03576446a902816ab0bbff2e7 Sep 09 23:28:25.770285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:28:25.770285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeTestJSON-1262781169-project Sep 09 23:28:25.770285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:28:25.770285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:28:25.770285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: f097c4fc270748cc8d41d7bcaba672a7 Sep 09 23:28:25.770285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeTestJSON-1262781169-project Sep 09 23:28:25.770285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:28:25.770285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. Sep 09 23:28:25.770285 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '026e4485-df9d-411d-98da-db2109bcf03b'} Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:28:25.771564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. Sep 09 23:28:25.777760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:25.779121 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fb0818df-0971-463a-a6f0-e13d96e5c23d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Returning 404 to user: Instance 026e4485-df9d-411d-98da-db2109bcf03b could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:28:25.779121 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-fb0818df-0971-463a-a6f0-e13d96e5c23d tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b" status: 404 len: 111 microversion: 2.1 time: 0.043462 Sep 09 23:28:25.779121 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 432/841] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:25 2022] GET /compute/v2.1/servers/026e4485-df9d-411d-98da-db2109bcf03b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:28:25.910651 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-35364716-12b4-44e5-a7f5-131d50fc3c11 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:25.911461 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-35364716-12b4-44e5-a7f5-131d50fc3c11 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:25.918177 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-35364716-12b4-44e5-a7f5-131d50fc3c11 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:25.919534 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-35364716-12b4-44e5-a7f5-131d50fc3c11 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:25.919534 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-35364716-12b4-44e5-a7f5-131d50fc3c11 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:25.920116 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-35364716-12b4-44e5-a7f5-131d50fc3c11 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:25.920678 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-35364716-12b4-44e5-a7f5-131d50fc3c11 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:25.921214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-35364716-12b4-44e5-a7f5-131d50fc3c11 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:26.080745 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-35364716-12b4-44e5-a7f5-131d50fc3c11 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:26.097673 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-35364716-12b4-44e5-a7f5-131d50fc3c11 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:26.099225 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-35364716-12b4-44e5-a7f5-131d50fc3c11 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:26.100534 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-35364716-12b4-44e5-a7f5-131d50fc3c11 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1738 microversion: 2.20 time: 0.193874 Sep 09 23:28:26.108092 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 410/842] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:25 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:26.140000 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-40cf328e-075c-4eec-b7be-7c741da407e1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:26.140798 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-40cf328e-075c-4eec-b7be-7c741da407e1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:26.148236 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-40cf328e-075c-4eec-b7be-7c741da407e1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:26.149030 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-40cf328e-075c-4eec-b7be-7c741da407e1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:26.149694 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-40cf328e-075c-4eec-b7be-7c741da407e1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:26.150594 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-40cf328e-075c-4eec-b7be-7c741da407e1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:26.151064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-40cf328e-075c-4eec-b7be-7c741da407e1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:26.151492 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-40cf328e-075c-4eec-b7be-7c741da407e1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:26.189883 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-40cf328e-075c-4eec-b7be-7c741da407e1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:26.189883 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-40cf328e-075c-4eec-b7be-7c741da407e1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:26.190485 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-40cf328e-075c-4eec-b7be-7c741da407e1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:26.190953 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-40cf328e-075c-4eec-b7be-7c741da407e1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lazy-loading 'fault' on Instance uuid 072aebfe-bdb3-47e7-9b55-deddc8c248e9 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:28:26.236934 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-40cf328e-075c-4eec-b7be-7c741da407e1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4129e5f14794a619acdaf5c56a02cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d0bb1d968841c2986b5eb164af953b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:26.245583 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-40cf328e-075c-4eec-b7be-7c741da407e1 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 200 len: 1348 microversion: 2.1 time: 0.111608 Sep 09 23:28:26.246487 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 433/843] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:26 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 1348 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:28:27.130194 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ee7ded18-91ad-4d71-8ac0-c025a5d48ad5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:27.131599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ee7ded18-91ad-4d71-8ac0-c025a5d48ad5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:27.135326 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:28:27.141116 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ee7ded18-91ad-4d71-8ac0-c025a5d48ad5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:27.141701 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ee7ded18-91ad-4d71-8ac0-c025a5d48ad5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:27.142200 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ee7ded18-91ad-4d71-8ac0-c025a5d48ad5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:27.142978 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ee7ded18-91ad-4d71-8ac0-c025a5d48ad5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:27.143515 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ee7ded18-91ad-4d71-8ac0-c025a5d48ad5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:27.144009 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ee7ded18-91ad-4d71-8ac0-c025a5d48ad5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:27.162048 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-6c7edc94-1e19-436c-9d78-42d172a2b254 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:27.162989 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-6c7edc94-1e19-436c-9d78-42d172a2b254 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:27.169658 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6c7edc94-1e19-436c-9d78-42d172a2b254 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:27.170223 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6c7edc94-1e19-436c-9d78-42d172a2b254 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:27.170704 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6c7edc94-1e19-436c-9d78-42d172a2b254 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:27.171469 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6c7edc94-1e19-436c-9d78-42d172a2b254 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:27.171907 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6c7edc94-1e19-436c-9d78-42d172a2b254 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:27.172331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6c7edc94-1e19-436c-9d78-42d172a2b254 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:27.187629 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-6c7edc94-1e19-436c-9d78-42d172a2b254 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] HTTP exception thrown: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-6c7edc94-1e19-436c-9d78-42d172a2b254 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Request method failure captured: Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: DELETE /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 HTTP/1.1 Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8pwuR6kqc7k0stDLKdFO4Ckk0gymyfMjIdGenSRMfvp5f3MJkij-SA0jpro4oueYSNQT201tvFKNLp_zoiAVeIBUcez9Cupz75IOKVWJp9SMAptEU2dx_Fm6ZH14If3_21qeS5XMAwu28pXoKNydVEVNi9I0hMe3b6lKrxXSIdkEpg Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 5c3517b03576446a902816ab0bbff2e7 Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:28:27.189284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:28:27.190919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c3517b03576446a902816ab0bbff2e7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:28:27.190919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:28:27.190919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 5c3517b03576446a902816ab0bbff2e7 Sep 09 23:28:27.190919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:28:27.190919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeTestJSON-1262781169-project Sep 09 23:28:27.190919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:28:27.190919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:28:27.190919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: f097c4fc270748cc8d41d7bcaba672a7 Sep 09 23:28:27.190919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeTestJSON-1262781169-project Sep 09 23:28:27.190919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:28:27.190919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. Sep 09 23:28:27.190919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': 'e56bd49b-8d5d-4de6-a394-2d097824a7c4'} Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:28:27.191815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. Sep 09 23:28:27.193911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:27.196951 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-6c7edc94-1e19-436c-9d78-42d172a2b254 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Returning 404 to user: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:28:27.196951 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-6c7edc94-1e19-436c-9d78-42d172a2b254 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 404 len: 111 microversion: 2.1 time: 0.032818 Sep 09 23:28:27.196951 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 434/844] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:28:27 2022] DELETE /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:28:27.204215 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-edb94c73-8d16-4c7b-b9d0-d20c3422a972 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:27.204832 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-edb94c73-8d16-4c7b-b9d0-d20c3422a972 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] [instance: e56bd49b-8d5d-4de6-a394-2d097824a7c4] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:27.213173 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-edb94c73-8d16-4c7b-b9d0-d20c3422a972 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:27.213637 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-edb94c73-8d16-4c7b-b9d0-d20c3422a972 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:27.214094 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-edb94c73-8d16-4c7b-b9d0-d20c3422a972 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:27.214942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-edb94c73-8d16-4c7b-b9d0-d20c3422a972 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:27.215487 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-edb94c73-8d16-4c7b-b9d0-d20c3422a972 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:27.215929 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-edb94c73-8d16-4c7b-b9d0-d20c3422a972 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:27.233882 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-edb94c73-8d16-4c7b-b9d0-d20c3422a972 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] HTTP exception thrown: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-edb94c73-8d16-4c7b-b9d0-d20c3422a972 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Request method failure captured: Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 HTTP/1.1 Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8pwuR6kqc7k0stDLKdFO4Ckk0gymyfMjIdGenSRMfvp5f3MJkij-SA0jpro4oueYSNQT201tvFKNLp_zoiAVeIBUcez9Cupz75IOKVWJp9SMAptEU2dx_Fm6ZH14If3_21qeS5XMAwu28pXoKNydVEVNi9I0hMe3b6lKrxXSIdkEpg Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 5c3517b03576446a902816ab0bbff2e7 Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:28:27.235785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:28:27.237415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c3517b03576446a902816ab0bbff2e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c3517b03576446a902816ab0bbff2e7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:28:27.237415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:28:27.237415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 5c3517b03576446a902816ab0bbff2e7 Sep 09 23:28:27.237415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1262781169 Sep 09 23:28:27.237415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeTestJSON-1262781169-project Sep 09 23:28:27.237415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:28:27.237415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:28:27.237415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: f097c4fc270748cc8d41d7bcaba672a7 Sep 09 23:28:27.237415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeTestJSON-1262781169-project Sep 09 23:28:27.237415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:28:27.237415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. Sep 09 23:28:27.237415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': 'e56bd49b-8d5d-4de6-a394-2d097824a7c4'} Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:28:27.238972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. Sep 09 23:28:27.240143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:27.297138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-edb94c73-8d16-4c7b-b9d0-d20c3422a972 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] Returning 404 to user: Instance e56bd49b-8d5d-4de6-a394-2d097824a7c4 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:28:27.297138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-edb94c73-8d16-4c7b-b9d0-d20c3422a972 tempest-AttachVolumeTestJSON-1262781169 tempest-AttachVolumeTestJSON-1262781169-project] 10.222.0.20 "GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4" status: 404 len: 111 microversion: 2.1 time: 0.036779 Sep 09 23:28:27.297138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 435/845] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:27 2022] GET /compute/v2.1/servers/e56bd49b-8d5d-4de6-a394-2d097824a7c4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:28:27.297138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e8266595-539a-4478-beef-e3aea9a45040 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:27.297138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e8266595-539a-4478-beef-e3aea9a45040 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] [instance: 072aebfe-bdb3-47e7-9b55-deddc8c248e9] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:27.298708 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e8266595-539a-4478-beef-e3aea9a45040 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:27.298708 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e8266595-539a-4478-beef-e3aea9a45040 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:27.298708 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e8266595-539a-4478-beef-e3aea9a45040 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:27.298708 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e8266595-539a-4478-beef-e3aea9a45040 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:27.299176 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e8266595-539a-4478-beef-e3aea9a45040 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:27.299176 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e8266595-539a-4478-beef-e3aea9a45040 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:27.299353 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ee7ded18-91ad-4d71-8ac0-c025a5d48ad5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:27.299691 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-e8266595-539a-4478-beef-e3aea9a45040 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] HTTP exception thrown: Instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 could not be found. Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e8266595-539a-4478-beef-e3aea9a45040 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Request method failure captured: Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 HTTP/1.1 Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8t2AC80OFE1jndiwbqzzi8Mvg_adPoH4Gc0N49QYpufZaH7AQfJHblL8FFfLwPsH5QykCxCQAoPh6v_tX1Q9YcUzLyKfgPg5FVF_slrZlo9J0IuYi7EhgqafrrexpGCc5MI3-ZdUZrRo3w7BvUdKzA5zKKMWgu-P97_hVENGhDKNuE Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 28d0bb1d968841c2986b5eb164af953b Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-TestMinimumBasicScenario-1771998118 Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:28:27.301284 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:28:27.303539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28d0bb1d968841c2986b5eb164af953b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28d0bb1d968841c2986b5eb164af953b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28d0bb1d968841c2986b5eb164af953b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28d0bb1d968841c2986b5eb164af953b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:28:27.303539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-TestMinimumBasicScenario-1771998118 Sep 09 23:28:27.303539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 28d0bb1d968841c2986b5eb164af953b Sep 09 23:28:27.303539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1771998118 Sep 09 23:28:27.303539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-TestMinimumBasicScenario-1771998118-project Sep 09 23:28:27.303539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:28:27.303539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:28:27.303539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: c4129e5f14794a619acdaf5c56a02cb8 Sep 09 23:28:27.303539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-TestMinimumBasicScenario-1771998118-project Sep 09 23:28:27.303539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:28:27.303539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 could not be found. Sep 09 23:28:27.303539 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '072aebfe-bdb3-47e7-9b55-deddc8c248e9'} Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 could not be found. Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:28:27.304442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 could not be found. Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 could not be found. Sep 09 23:28:27.305881 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:28:27.307282 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e8266595-539a-4478-beef-e3aea9a45040 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Returning 404 to user: Instance 072aebfe-bdb3-47e7-9b55-deddc8c248e9 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:28:27.307282 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e8266595-539a-4478-beef-e3aea9a45040 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9" status: 404 len: 111 microversion: 2.1 time: 0.037571 Sep 09 23:28:27.307705 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 436/846] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:27 2022] GET /compute/v2.1/servers/072aebfe-bdb3-47e7-9b55-deddc8c248e9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:28:27.309469 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ee7ded18-91ad-4d71-8ac0-c025a5d48ad5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:27.311063 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ee7ded18-91ad-4d71-8ac0-c025a5d48ad5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:27.312378 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ee7ded18-91ad-4d71-8ac0-c025a5d48ad5 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1738 microversion: 2.20 time: 0.187229 Sep 09 23:28:27.312701 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-839c7d0d-e421-4d80-8622-c06a9c6530d4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] Calling method '.version_select at 0x7f908dbf0940>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:27.313273 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 411/847] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:27 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:27.543087 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-839c7d0d-e421-4d80-8622-c06a9c6530d4 tempest-TestMinimumBasicScenario-1771998118 tempest-TestMinimumBasicScenario-1771998118-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1311011562" status: 202 len: 0 microversion: 2.1 time: 0.234241 Sep 09 23:28:27.544088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 437/848] 10.222.0.20 () {58 vars in 1272 bytes} [Fri Sep 9 23:28:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1311011562 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:28:28.340182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-74aabcc5-72d9-4033-b52f-316250b382e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:28.340805 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-74aabcc5-72d9-4033-b52f-316250b382e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:28.352277 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-74aabcc5-72d9-4033-b52f-316250b382e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:28.352925 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-74aabcc5-72d9-4033-b52f-316250b382e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:28.353595 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-74aabcc5-72d9-4033-b52f-316250b382e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:28.354495 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-74aabcc5-72d9-4033-b52f-316250b382e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:28.355124 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-74aabcc5-72d9-4033-b52f-316250b382e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:28.355924 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-74aabcc5-72d9-4033-b52f-316250b382e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:28.536299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-74aabcc5-72d9-4033-b52f-316250b382e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:28.552289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-74aabcc5-72d9-4033-b52f-316250b382e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:28.555169 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-74aabcc5-72d9-4033-b52f-316250b382e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:28.556773 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-74aabcc5-72d9-4033-b52f-316250b382e0 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1738 microversion: 2.20 time: 0.220811 Sep 09 23:28:28.557556 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 412/849] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:28 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:29.587231 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-aa981157-c35e-422a-9c3a-c2e5b781dda2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:29.589190 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-aa981157-c35e-422a-9c3a-c2e5b781dda2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:29.631404 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa981157-c35e-422a-9c3a-c2e5b781dda2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:29.632165 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa981157-c35e-422a-9c3a-c2e5b781dda2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:29.634330 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa981157-c35e-422a-9c3a-c2e5b781dda2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:29.635316 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa981157-c35e-422a-9c3a-c2e5b781dda2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:29.635943 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa981157-c35e-422a-9c3a-c2e5b781dda2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:29.636563 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa981157-c35e-422a-9c3a-c2e5b781dda2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:29.924500 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-aa981157-c35e-422a-9c3a-c2e5b781dda2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:29.939064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-aa981157-c35e-422a-9c3a-c2e5b781dda2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:29.940788 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-aa981157-c35e-422a-9c3a-c2e5b781dda2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:29.946375 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-aa981157-c35e-422a-9c3a-c2e5b781dda2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1738 microversion: 2.20 time: 0.363388 Sep 09 23:28:29.947177 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 438/850] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:29 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1738 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:30.975898 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ceb015f6-cbdc-4e47-ac3a-c2c1af2a72b2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:30.976892 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ceb015f6-cbdc-4e47-ac3a-c2c1af2a72b2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:30.986602 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ceb015f6-cbdc-4e47-ac3a-c2c1af2a72b2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:30.987323 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ceb015f6-cbdc-4e47-ac3a-c2c1af2a72b2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:30.987932 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ceb015f6-cbdc-4e47-ac3a-c2c1af2a72b2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:30.988795 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ceb015f6-cbdc-4e47-ac3a-c2c1af2a72b2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:30.989391 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ceb015f6-cbdc-4e47-ac3a-c2c1af2a72b2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:30.989821 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ceb015f6-cbdc-4e47-ac3a-c2c1af2a72b2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:31.017144 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:28:31.153356 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ceb015f6-cbdc-4e47-ac3a-c2c1af2a72b2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:31.163687 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ceb015f6-cbdc-4e47-ac3a-c2c1af2a72b2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:31.165149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ceb015f6-cbdc-4e47-ac3a-c2c1af2a72b2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:31.166380 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ceb015f6-cbdc-4e47-ac3a-c2c1af2a72b2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1738 microversion: 2.20 time: 0.195699 Sep 09 23:28:31.167017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 413/851] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:30 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:32.192931 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3ed2fa6f-1ffe-4fa9-bae1-d7e8d2d70b4e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:32.193627 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3ed2fa6f-1ffe-4fa9-bae1-d7e8d2d70b4e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:32.205448 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ed2fa6f-1ffe-4fa9-bae1-d7e8d2d70b4e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:32.205448 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ed2fa6f-1ffe-4fa9-bae1-d7e8d2d70b4e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:32.205448 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ed2fa6f-1ffe-4fa9-bae1-d7e8d2d70b4e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:32.205448 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ed2fa6f-1ffe-4fa9-bae1-d7e8d2d70b4e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:32.205809 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ed2fa6f-1ffe-4fa9-bae1-d7e8d2d70b4e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:32.205809 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3ed2fa6f-1ffe-4fa9-bae1-d7e8d2d70b4e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:32.633149 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3ed2fa6f-1ffe-4fa9-bae1-d7e8d2d70b4e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:32.642882 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3ed2fa6f-1ffe-4fa9-bae1-d7e8d2d70b4e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:32.644384 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3ed2fa6f-1ffe-4fa9-bae1-d7e8d2d70b4e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:32.645570 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3ed2fa6f-1ffe-4fa9-bae1-d7e8d2d70b4e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1738 microversion: 2.20 time: 0.456795 Sep 09 23:28:32.658616 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 439/852] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:32 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1738 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:28:33.674426 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-bc47f853-d560-4726-83c7-f73f20a2f447 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:33.675048 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-bc47f853-d560-4726-83c7-f73f20a2f447 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:33.685583 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bc47f853-d560-4726-83c7-f73f20a2f447 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:33.686524 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bc47f853-d560-4726-83c7-f73f20a2f447 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:33.687157 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bc47f853-d560-4726-83c7-f73f20a2f447 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:33.688046 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bc47f853-d560-4726-83c7-f73f20a2f447 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:33.688764 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bc47f853-d560-4726-83c7-f73f20a2f447 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:33.689352 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-bc47f853-d560-4726-83c7-f73f20a2f447 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:33.903255 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bc47f853-d560-4726-83c7-f73f20a2f447 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:33.914189 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bc47f853-d560-4726-83c7-f73f20a2f447 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:33.915676 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-bc47f853-d560-4726-83c7-f73f20a2f447 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:33.917654 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-bc47f853-d560-4726-83c7-f73f20a2f447 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1720 microversion: 2.20 time: 0.247742 Sep 09 23:28:33.918467 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 414/853] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:33 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1720 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:34.956644 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3f442b0f-bd15-4697-b3c6-9e65c03e0f4f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:34.957913 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3f442b0f-bd15-4697-b3c6-9e65c03e0f4f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:34.968926 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3f442b0f-bd15-4697-b3c6-9e65c03e0f4f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:34.968926 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3f442b0f-bd15-4697-b3c6-9e65c03e0f4f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:34.968926 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3f442b0f-bd15-4697-b3c6-9e65c03e0f4f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:34.968926 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3f442b0f-bd15-4697-b3c6-9e65c03e0f4f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:34.969320 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3f442b0f-bd15-4697-b3c6-9e65c03e0f4f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:34.969320 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3f442b0f-bd15-4697-b3c6-9e65c03e0f4f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:35.183730 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3f442b0f-bd15-4697-b3c6-9e65c03e0f4f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:35.192636 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3f442b0f-bd15-4697-b3c6-9e65c03e0f4f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:35.194642 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3f442b0f-bd15-4697-b3c6-9e65c03e0f4f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:35.203578 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3f442b0f-bd15-4697-b3c6-9e65c03e0f4f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1720 microversion: 2.20 time: 0.251036 Sep 09 23:28:35.206394 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 440/854] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:34 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:35.622749 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-3a3e8b49-489f-4bb1-ab5e-417cc9fc7e88 req-52513b66-2e91-48df-b7d5-b9d8bda7f41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a008236c-707a-4578-912c-07adedbb10cb", "name": "network-vif-unplugged", "status": "completed", "tag": "b8c3dd2c-6785-40c3-87d8-e3d4dae738c5"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:28:35.643252 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-3a3e8b49-489f-4bb1-ab5e-417cc9fc7e88 req-52513b66-2e91-48df-b7d5-b9d8bda7f41b service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:35.643980 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-3a3e8b49-489f-4bb1-ab5e-417cc9fc7e88 req-52513b66-2e91-48df-b7d5-b9d8bda7f41b service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:35.644690 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-3a3e8b49-489f-4bb1-ab5e-417cc9fc7e88 req-52513b66-2e91-48df-b7d5-b9d8bda7f41b service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:35.665236 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-3a3e8b49-489f-4bb1-ab5e-417cc9fc7e88 req-52513b66-2e91-48df-b7d5-b9d8bda7f41b service nova] Creating event network-vif-unplugged:b8c3dd2c-6785-40c3-87d8-e3d4dae738c5 for instance a008236c-707a-4578-912c-07adedbb10cb on hv-cinder-85032 Sep 09 23:28:35.672301 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-3a3e8b49-489f-4bb1-ab5e-417cc9fc7e88 req-52513b66-2e91-48df-b7d5-b9d8bda7f41b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053151 Sep 09 23:28:35.673230 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 415/855] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:28:36.236542 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c74db669-1c79-4e72-949e-ecbac967b892 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:36.237072 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-c74db669-1c79-4e72-949e-ecbac967b892 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:36.244973 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c74db669-1c79-4e72-949e-ecbac967b892 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:36.245467 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c74db669-1c79-4e72-949e-ecbac967b892 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:36.245902 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c74db669-1c79-4e72-949e-ecbac967b892 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:36.246625 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c74db669-1c79-4e72-949e-ecbac967b892 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:36.247209 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c74db669-1c79-4e72-949e-ecbac967b892 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:36.247750 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c74db669-1c79-4e72-949e-ecbac967b892 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:36.572673 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-c74db669-1c79-4e72-949e-ecbac967b892 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:36.581783 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-c74db669-1c79-4e72-949e-ecbac967b892 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:36.587582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-c74db669-1c79-4e72-949e-ecbac967b892 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:36.591092 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-c74db669-1c79-4e72-949e-ecbac967b892 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1720 microversion: 2.20 time: 0.358316 Sep 09 23:28:36.593466 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 441/856] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:36 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1720 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:37.630287 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-11669e26-41fe-4cff-8b3c-d505a4936962 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:37.632336 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-11669e26-41fe-4cff-8b3c-d505a4936962 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:37.639562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-11669e26-41fe-4cff-8b3c-d505a4936962 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:37.640494 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-11669e26-41fe-4cff-8b3c-d505a4936962 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:37.641207 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-11669e26-41fe-4cff-8b3c-d505a4936962 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:37.643684 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-11669e26-41fe-4cff-8b3c-d505a4936962 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:37.644414 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-11669e26-41fe-4cff-8b3c-d505a4936962 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:37.645217 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-11669e26-41fe-4cff-8b3c-d505a4936962 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:37.955479 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-11669e26-41fe-4cff-8b3c-d505a4936962 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:37.986157 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-11669e26-41fe-4cff-8b3c-d505a4936962 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:37.988301 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-11669e26-41fe-4cff-8b3c-d505a4936962 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:37.989658 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-11669e26-41fe-4cff-8b3c-d505a4936962 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1663 microversion: 2.20 time: 0.367094 Sep 09 23:28:38.007313 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 416/857] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:37 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1663 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:38.024635 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e879037b-9d68-4369-a896-add325584320 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a6734c6-5baf-40ed-b9ad-15dfb3226a14"}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:28:38.027214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e879037b-9d68-4369-a896-add325584320 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:38.043534 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e879037b-9d68-4369-a896-add325584320 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:38.044041 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e879037b-9d68-4369-a896-add325584320 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:38.046703 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e879037b-9d68-4369-a896-add325584320 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:38.047453 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e879037b-9d68-4369-a896-add325584320 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:38.047932 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e879037b-9d68-4369-a896-add325584320 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:38.048366 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e879037b-9d68-4369-a896-add325584320 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:39.259564 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e879037b-9d68-4369-a896-add325584320 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "POST /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.239639 Sep 09 23:28:39.260245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 442/858] 10.222.0.20 () {62 vars in 1364 bytes} [Fri Sep 9 23:28:38 2022] POST /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb/os-volume_attachments => generated 188 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 23:28:39.430623 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-56caba57-ccc8-44d3-a29a-6faaba35fe56 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:39.431998 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-56caba57-ccc8-44d3-a29a-6faaba35fe56 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:39.438936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56caba57-ccc8-44d3-a29a-6faaba35fe56 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:39.439627 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56caba57-ccc8-44d3-a29a-6faaba35fe56 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:39.440233 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56caba57-ccc8-44d3-a29a-6faaba35fe56 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:39.441087 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56caba57-ccc8-44d3-a29a-6faaba35fe56 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:39.441945 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56caba57-ccc8-44d3-a29a-6faaba35fe56 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:39.442550 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56caba57-ccc8-44d3-a29a-6faaba35fe56 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:40.383622 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5b16d124-ab7d-46de-868f-fe23d7d67c6c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Action: 'create', calling method: .version_select at 0x7f908dbf0940>, body: {"keypair": {"name": "tempest-keypair-409061248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOq7flPcnL7717Ypn0BYlR65A75AUNdWuwWGJp00cqvuzbt9VQ7+K1WtB9gUPVtL3yKNJ6rGysY41vYB87jZdYeS8dVp1feG3mRB6W1dBGUWNcAMC8NLowdLGIcyVxdHA=="}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:28:40.401046 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-5b16d124-ab7d-46de-868f-fe23d7d67c6c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'key_pairs'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:28:40.405195 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-5b16d124-ab7d-46de-868f-fe23d7d67c6c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for user 592da799f0c540d68a2cc6d54006467c and project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'key_pairs'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:28:40.508960 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5b16d124-ab7d-46de-868f-fe23d7d67c6c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.263349 Sep 09 23:28:40.509756 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 443/859] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 23:28:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:28:41.093648 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-56caba57-ccc8-44d3-a29a-6faaba35fe56 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb/os-volume_attachments/2a6734c6-5baf-40ed-b9ad-15dfb3226a14" status: 202 len: 0 microversion: 2.20 time: 1.667662 Sep 09 23:28:41.099221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 417/860] 10.222.0.20 () {60 vars in 1457 bytes} [Fri Sep 9 23:28:39 2022] DELETE /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb/os-volume_attachments/2a6734c6-5baf-40ed-b9ad-15dfb3226a14 => generated 0 bytes in 1675 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:28:41.188657 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-014867b1-d555-4e69-868a-7278da3fe390 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:28:41.189248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-014867b1-d555-4e69-868a-7278da3fe390 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:41.197119 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-014867b1-d555-4e69-868a-7278da3fe390 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:41.197904 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-014867b1-d555-4e69-868a-7278da3fe390 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:41.198828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-014867b1-d555-4e69-868a-7278da3fe390 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:41.200399 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-014867b1-d555-4e69-868a-7278da3fe390 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:41.201242 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-014867b1-d555-4e69-868a-7278da3fe390 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:41.201987 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-014867b1-d555-4e69-868a-7278da3fe390 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:41.269126 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-014867b1-d555-4e69-868a-7278da3fe390 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121059) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 23:28:41.792442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-014867b1-d555-4e69-868a-7278da3fe390 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "POST /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb/action" status: 202 len: 0 microversion: 2.20 time: 0.607724 Sep 09 23:28:41.793758 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 444/861] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Sep 9 23:28:41 2022] POST /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:28:41.808727 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e7e1904a-5949-415d-9069-21a9ac487bab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:41.811051 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e7e1904a-5949-415d-9069-21a9ac487bab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:41.826807 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7e1904a-5949-415d-9069-21a9ac487bab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:41.830684 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7e1904a-5949-415d-9069-21a9ac487bab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:41.830684 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7e1904a-5949-415d-9069-21a9ac487bab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:41.831295 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7e1904a-5949-415d-9069-21a9ac487bab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:41.831988 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7e1904a-5949-415d-9069-21a9ac487bab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:41.832475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7e1904a-5949-415d-9069-21a9ac487bab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:42.118113 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e7e1904a-5949-415d-9069-21a9ac487bab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:42.141008 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e7e1904a-5949-415d-9069-21a9ac487bab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:42.141008 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e7e1904a-5949-415d-9069-21a9ac487bab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:42.141008 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e7e1904a-5949-415d-9069-21a9ac487bab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1671 microversion: 2.20 time: 0.332757 Sep 09 23:28:42.141382 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 418/862] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:41 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1671 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:43.166717 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-bfb444ae-37c3-45f7-88ac-60696fe04791 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:43.167993 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-bfb444ae-37c3-45f7-88ac-60696fe04791 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:43.174968 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bfb444ae-37c3-45f7-88ac-60696fe04791 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:43.175738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bfb444ae-37c3-45f7-88ac-60696fe04791 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:43.176332 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bfb444ae-37c3-45f7-88ac-60696fe04791 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:43.177208 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bfb444ae-37c3-45f7-88ac-60696fe04791 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:43.178535 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bfb444ae-37c3-45f7-88ac-60696fe04791 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:43.179121 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bfb444ae-37c3-45f7-88ac-60696fe04791 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:43.366922 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-bfb444ae-37c3-45f7-88ac-60696fe04791 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:43.379682 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-bfb444ae-37c3-45f7-88ac-60696fe04791 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:43.383612 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-bfb444ae-37c3-45f7-88ac-60696fe04791 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:43.385200 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-bfb444ae-37c3-45f7-88ac-60696fe04791 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1671 microversion: 2.20 time: 0.225392 Sep 09 23:28:43.386874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 445/863] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:43 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1671 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:43.419372 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1999442222", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a5627a6-2ca5-4346-988f-094c3aa681f1"}], "security_groups": [{"name": "tempest-securitygroup--1433003221"}], "key_name": "tempest-keypair-409061248", "user_data": "}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:28:43.592422 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.network.neutron [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] validate_networks() for [('9a5627a6-2ca5-4346-988f-094c3aa681f1', None, None, None, None, None)] {{(pid=121058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:28:44.068767 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Flavor limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:28:44.069555 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Image limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:28:44.070199 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Flavor pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:28:44.070821 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Image pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:28:44.071402 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:28:44.087226 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:44.090061 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:44.090713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:44.093550 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:44.094232 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:44.094993 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:44.125269 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:28:44.129888 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for user 592da799f0c540d68a2cc6d54006467c and project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:28:44.144207 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Going to run 1 instances... {{(pid=121058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:28:44.148025 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:28:44.340963 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-264aa7f5-4d4c-4d57-9da5-60ea9e186eb1 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.925765 Sep 09 23:28:44.342523 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 419/864] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:28:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:28:44.354579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-07304a1a-81c2-4d91-aad9-83395f46fb23 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:44.355186 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-07304a1a-81c2-4d91-aad9-83395f46fb23 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:44.430394 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4a3d846c-866c-48f9-829f-71a8255ca4d3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:44.431089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4a3d846c-866c-48f9-829f-71a8255ca4d3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:44.448348 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4a3d846c-866c-48f9-829f-71a8255ca4d3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:44.448843 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4a3d846c-866c-48f9-829f-71a8255ca4d3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:44.449279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4a3d846c-866c-48f9-829f-71a8255ca4d3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:44.449994 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4a3d846c-866c-48f9-829f-71a8255ca4d3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:44.450621 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4a3d846c-866c-48f9-829f-71a8255ca4d3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:44.451226 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4a3d846c-866c-48f9-829f-71a8255ca4d3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:44.519457 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-07304a1a-81c2-4d91-aad9-83395f46fb23 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:44.530368 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-07304a1a-81c2-4d91-aad9-83395f46fb23 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1241 microversion: 2.1 time: 0.178166 Sep 09 23:28:44.539431 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 446/865] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:44 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1241 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:28:44.697964 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4a3d846c-866c-48f9-829f-71a8255ca4d3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:44.710444 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4a3d846c-866c-48f9-829f-71a8255ca4d3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:44.713072 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4a3d846c-866c-48f9-829f-71a8255ca4d3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:44.723364 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4a3d846c-866c-48f9-829f-71a8255ca4d3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.313130 Sep 09 23:28:44.741657 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 420/866] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:44 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:45.562926 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-6c011561-07fc-4a2a-a67b-9274ec43f536 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:45.562926 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-6c011561-07fc-4a2a-a67b-9274ec43f536 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:45.630818 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-6c011561-07fc-4a2a-a67b-9274ec43f536 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:45.640192 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-6c011561-07fc-4a2a-a67b-9274ec43f536 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1241 microversion: 2.1 time: 0.090758 Sep 09 23:28:45.641116 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 447/867] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:45 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:28:45.769371 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-56de26a2-ce8c-444b-8e86-253ef98d5917 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:45.770013 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-56de26a2-ce8c-444b-8e86-253ef98d5917 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:45.786488 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56de26a2-ce8c-444b-8e86-253ef98d5917 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:45.788811 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56de26a2-ce8c-444b-8e86-253ef98d5917 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:45.789819 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56de26a2-ce8c-444b-8e86-253ef98d5917 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:45.798619 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56de26a2-ce8c-444b-8e86-253ef98d5917 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:45.798619 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56de26a2-ce8c-444b-8e86-253ef98d5917 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:45.798619 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-56de26a2-ce8c-444b-8e86-253ef98d5917 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:45.963716 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-56de26a2-ce8c-444b-8e86-253ef98d5917 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:45.975138 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-56de26a2-ce8c-444b-8e86-253ef98d5917 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:45.979168 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-56de26a2-ce8c-444b-8e86-253ef98d5917 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:45.981772 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-56de26a2-ce8c-444b-8e86-253ef98d5917 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.217795 Sep 09 23:28:45.983065 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 421/868] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:45 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:46.686674 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-24b0f778-146d-4fff-8a98-7e612e112409 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:46.687556 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-24b0f778-146d-4fff-8a98-7e612e112409 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:46.699992 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-24b0f778-146d-4fff-8a98-7e612e112409 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:46.700478 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-24b0f778-146d-4fff-8a98-7e612e112409 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:46.700911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-24b0f778-146d-4fff-8a98-7e612e112409 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:46.701618 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-24b0f778-146d-4fff-8a98-7e612e112409 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:46.702071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-24b0f778-146d-4fff-8a98-7e612e112409 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:46.702526 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-24b0f778-146d-4fff-8a98-7e612e112409 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:46.806130 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-24b0f778-146d-4fff-8a98-7e612e112409 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:46.817382 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-24b0f778-146d-4fff-8a98-7e612e112409 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1237 microversion: 2.1 time: 0.141461 Sep 09 23:28:46.818584 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 448/869] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:46 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1237 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:28:47.020415 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-803a0852-f391-4913-9232-3f6d89274600 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:47.021732 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-803a0852-f391-4913-9232-3f6d89274600 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:47.029738 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-803a0852-f391-4913-9232-3f6d89274600 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:47.030461 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-803a0852-f391-4913-9232-3f6d89274600 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:47.031133 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-803a0852-f391-4913-9232-3f6d89274600 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:47.032135 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-803a0852-f391-4913-9232-3f6d89274600 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:47.033417 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-803a0852-f391-4913-9232-3f6d89274600 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:47.034024 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-803a0852-f391-4913-9232-3f6d89274600 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:47.256204 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-803a0852-f391-4913-9232-3f6d89274600 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:47.267071 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-803a0852-f391-4913-9232-3f6d89274600 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:47.268558 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-803a0852-f391-4913-9232-3f6d89274600 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:47.269796 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-803a0852-f391-4913-9232-3f6d89274600 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.255055 Sep 09 23:28:47.270376 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 422/870] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:47 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:47.851303 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e293cd18-dd1f-4e0d-861d-9fd5a51ef902 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:47.852258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e293cd18-dd1f-4e0d-861d-9fd5a51ef902 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:47.867452 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e293cd18-dd1f-4e0d-861d-9fd5a51ef902 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:47.868212 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e293cd18-dd1f-4e0d-861d-9fd5a51ef902 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:47.868879 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e293cd18-dd1f-4e0d-861d-9fd5a51ef902 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:47.869905 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e293cd18-dd1f-4e0d-861d-9fd5a51ef902 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:47.870939 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e293cd18-dd1f-4e0d-861d-9fd5a51ef902 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:47.872075 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e293cd18-dd1f-4e0d-861d-9fd5a51ef902 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:47.989957 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e293cd18-dd1f-4e0d-861d-9fd5a51ef902 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:48.005861 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e293cd18-dd1f-4e0d-861d-9fd5a51ef902 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1293 microversion: 2.1 time: 0.159965 Sep 09 23:28:48.018958 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 449/871] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:47 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1293 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:28:48.298823 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-361d56ce-fa4b-4ba8-8dba-add22f5b6e8e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:48.300137 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-361d56ce-fa4b-4ba8-8dba-add22f5b6e8e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:48.317499 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-361d56ce-fa4b-4ba8-8dba-add22f5b6e8e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:48.318493 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-361d56ce-fa4b-4ba8-8dba-add22f5b6e8e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:48.319562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-361d56ce-fa4b-4ba8-8dba-add22f5b6e8e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:48.320692 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-361d56ce-fa4b-4ba8-8dba-add22f5b6e8e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:48.321499 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-361d56ce-fa4b-4ba8-8dba-add22f5b6e8e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:48.324068 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-361d56ce-fa4b-4ba8-8dba-add22f5b6e8e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:48.637220 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-361d56ce-fa4b-4ba8-8dba-add22f5b6e8e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:48.648278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-361d56ce-fa4b-4ba8-8dba-add22f5b6e8e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:48.650376 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-361d56ce-fa4b-4ba8-8dba-add22f5b6e8e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:48.662115 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-361d56ce-fa4b-4ba8-8dba-add22f5b6e8e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.358680 Sep 09 23:28:48.662115 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 423/872] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:48 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:49.031867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b71db20b-66e9-40fc-9280-96e07dda9c06 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:49.037496 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b71db20b-66e9-40fc-9280-96e07dda9c06 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:49.049791 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b71db20b-66e9-40fc-9280-96e07dda9c06 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:49.050296 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b71db20b-66e9-40fc-9280-96e07dda9c06 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:49.050762 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b71db20b-66e9-40fc-9280-96e07dda9c06 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:49.051487 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b71db20b-66e9-40fc-9280-96e07dda9c06 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:49.051944 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b71db20b-66e9-40fc-9280-96e07dda9c06 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:49.052477 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b71db20b-66e9-40fc-9280-96e07dda9c06 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:49.191602 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b71db20b-66e9-40fc-9280-96e07dda9c06 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:49.203057 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b71db20b-66e9-40fc-9280-96e07dda9c06 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1293 microversion: 2.1 time: 0.175720 Sep 09 23:28:49.204198 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 450/873] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:49 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1293 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:28:49.683145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e0d2938f-1d1e-43ad-a323-5af29089fa46 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:49.684351 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e0d2938f-1d1e-43ad-a323-5af29089fa46 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:49.702410 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e0d2938f-1d1e-43ad-a323-5af29089fa46 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:49.703450 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e0d2938f-1d1e-43ad-a323-5af29089fa46 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:49.704359 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e0d2938f-1d1e-43ad-a323-5af29089fa46 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:49.705648 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e0d2938f-1d1e-43ad-a323-5af29089fa46 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:49.706422 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e0d2938f-1d1e-43ad-a323-5af29089fa46 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:49.707225 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e0d2938f-1d1e-43ad-a323-5af29089fa46 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:49.996515 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e0d2938f-1d1e-43ad-a323-5af29089fa46 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:50.007853 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e0d2938f-1d1e-43ad-a323-5af29089fa46 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:50.009595 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e0d2938f-1d1e-43ad-a323-5af29089fa46 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:50.011059 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e0d2938f-1d1e-43ad-a323-5af29089fa46 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.332451 Sep 09 23:28:50.012033 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 424/874] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:49 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:50.228584 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-df3bf292-8ed8-4094-bf01-aa6c59fbc2b4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:50.229486 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-df3bf292-8ed8-4094-bf01-aa6c59fbc2b4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:50.251773 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-df3bf292-8ed8-4094-bf01-aa6c59fbc2b4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:50.252957 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-df3bf292-8ed8-4094-bf01-aa6c59fbc2b4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:50.253418 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-df3bf292-8ed8-4094-bf01-aa6c59fbc2b4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:50.256380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-df3bf292-8ed8-4094-bf01-aa6c59fbc2b4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:50.257083 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-df3bf292-8ed8-4094-bf01-aa6c59fbc2b4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:50.257701 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-df3bf292-8ed8-4094-bf01-aa6c59fbc2b4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:50.307307 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:28:50.354550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-df3bf292-8ed8-4094-bf01-aa6c59fbc2b4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:50.364077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-df3bf292-8ed8-4094-bf01-aa6c59fbc2b4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1293 microversion: 2.1 time: 0.140100 Sep 09 23:28:50.365789 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 451/875] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:50 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1293 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:28:51.040280 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-560cb782-8822-4421-9d43-42ba3cf7c8a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:51.040915 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-560cb782-8822-4421-9d43-42ba3cf7c8a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:51.051960 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-560cb782-8822-4421-9d43-42ba3cf7c8a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:51.053769 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-560cb782-8822-4421-9d43-42ba3cf7c8a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:51.056596 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-560cb782-8822-4421-9d43-42ba3cf7c8a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:51.057525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-560cb782-8822-4421-9d43-42ba3cf7c8a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:51.058728 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-560cb782-8822-4421-9d43-42ba3cf7c8a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:51.061974 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-560cb782-8822-4421-9d43-42ba3cf7c8a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:51.344241 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-560cb782-8822-4421-9d43-42ba3cf7c8a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:51.360666 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-560cb782-8822-4421-9d43-42ba3cf7c8a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:51.375414 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-560cb782-8822-4421-9d43-42ba3cf7c8a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:51.389169 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b000d4ea-072f-415b-b27d-30d592b04818 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:51.389780 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b000d4ea-072f-415b-b27d-30d592b04818 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:51.390402 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-560cb782-8822-4421-9d43-42ba3cf7c8a6 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.340491 Sep 09 23:28:51.391083 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 425/876] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:51 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:51.406935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b000d4ea-072f-415b-b27d-30d592b04818 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:51.407468 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b000d4ea-072f-415b-b27d-30d592b04818 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:51.408013 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b000d4ea-072f-415b-b27d-30d592b04818 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:51.408762 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b000d4ea-072f-415b-b27d-30d592b04818 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:51.409398 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b000d4ea-072f-415b-b27d-30d592b04818 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:51.410012 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b000d4ea-072f-415b-b27d-30d592b04818 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:51.558067 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b000d4ea-072f-415b-b27d-30d592b04818 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:51.574603 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b000d4ea-072f-415b-b27d-30d592b04818 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1293 microversion: 2.1 time: 0.190426 Sep 09 23:28:51.576714 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 452/877] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:51 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1293 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:28:52.427938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-76383aec-f07a-4775-9019-cf73661f19ab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:52.428732 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-76383aec-f07a-4775-9019-cf73661f19ab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:52.445017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-76383aec-f07a-4775-9019-cf73661f19ab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:52.448029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-76383aec-f07a-4775-9019-cf73661f19ab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:52.449192 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-76383aec-f07a-4775-9019-cf73661f19ab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:52.463057 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-76383aec-f07a-4775-9019-cf73661f19ab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:52.463057 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-76383aec-f07a-4775-9019-cf73661f19ab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:52.463057 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-76383aec-f07a-4775-9019-cf73661f19ab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:52.601769 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0bc76719-9e95-4fe0-8124-5dabe5686a03 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:52.603714 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-0bc76719-9e95-4fe0-8124-5dabe5686a03 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:52.613457 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0bc76719-9e95-4fe0-8124-5dabe5686a03 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:52.617168 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0bc76719-9e95-4fe0-8124-5dabe5686a03 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:52.617168 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0bc76719-9e95-4fe0-8124-5dabe5686a03 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:52.617168 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0bc76719-9e95-4fe0-8124-5dabe5686a03 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:52.617168 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0bc76719-9e95-4fe0-8124-5dabe5686a03 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:52.630173 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0bc76719-9e95-4fe0-8124-5dabe5686a03 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:52.676677 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-76383aec-f07a-4775-9019-cf73661f19ab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:52.688661 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-76383aec-f07a-4775-9019-cf73661f19ab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:52.690563 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-76383aec-f07a-4775-9019-cf73661f19ab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:52.710212 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-76383aec-f07a-4775-9019-cf73661f19ab tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.277033 Sep 09 23:28:52.713081 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 426/878] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:52 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:52.821867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-0bc76719-9e95-4fe0-8124-5dabe5686a03 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:52.833979 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-0bc76719-9e95-4fe0-8124-5dabe5686a03 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1293 microversion: 2.1 time: 0.237535 Sep 09 23:28:52.836594 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 453/879] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:52 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1293 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:28:53.717354 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7d3decf7-8a65-4068-911e-78607e22d7c2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:53.718491 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7d3decf7-8a65-4068-911e-78607e22d7c2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:53.738330 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d3decf7-8a65-4068-911e-78607e22d7c2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:53.739138 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d3decf7-8a65-4068-911e-78607e22d7c2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:53.740647 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d3decf7-8a65-4068-911e-78607e22d7c2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:53.741999 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d3decf7-8a65-4068-911e-78607e22d7c2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:53.742498 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d3decf7-8a65-4068-911e-78607e22d7c2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:53.742938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d3decf7-8a65-4068-911e-78607e22d7c2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:53.865658 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-9e9e89fe-0042-4657-b1f6-0935135624b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:53.866352 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-9e9e89fe-0042-4657-b1f6-0935135624b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:53.872959 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:28:53.882940 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9e9e89fe-0042-4657-b1f6-0935135624b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:53.883700 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9e9e89fe-0042-4657-b1f6-0935135624b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:53.884383 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9e9e89fe-0042-4657-b1f6-0935135624b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:53.888945 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9e9e89fe-0042-4657-b1f6-0935135624b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:53.889611 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9e9e89fe-0042-4657-b1f6-0935135624b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:53.890594 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-9e9e89fe-0042-4657-b1f6-0935135624b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:54.111254 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=2 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:28:54.139662 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=6 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:28:54.178601 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7d3decf7-8a65-4068-911e-78607e22d7c2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:54.198131 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7d3decf7-8a65-4068-911e-78607e22d7c2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:54.200665 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7d3decf7-8a65-4068-911e-78607e22d7c2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:54.202947 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7d3decf7-8a65-4068-911e-78607e22d7c2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.489398 Sep 09 23:28:54.204146 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 427/880] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:53 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:54.234626 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-9e9e89fe-0042-4657-b1f6-0935135624b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:54.260823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-9e9e89fe-0042-4657-b1f6-0935135624b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1301 microversion: 2.1 time: 0.400513 Sep 09 23:28:54.263060 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 454/881] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:53 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1301 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:28:55.232034 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4b64eae5-14be-40a1-81cb-304e67702c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:55.233353 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4b64eae5-14be-40a1-81cb-304e67702c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:55.243165 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b64eae5-14be-40a1-81cb-304e67702c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:55.243857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b64eae5-14be-40a1-81cb-304e67702c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:55.244374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b64eae5-14be-40a1-81cb-304e67702c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:55.245475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b64eae5-14be-40a1-81cb-304e67702c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:55.246248 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b64eae5-14be-40a1-81cb-304e67702c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:55.247072 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b64eae5-14be-40a1-81cb-304e67702c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:55.289668 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e9dcb2f0-7825-4109-9c09-9a7c0c80762e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:55.293939 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e9dcb2f0-7825-4109-9c09-9a7c0c80762e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:55.297573 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9dcb2f0-7825-4109-9c09-9a7c0c80762e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:55.298803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9dcb2f0-7825-4109-9c09-9a7c0c80762e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:55.299434 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9dcb2f0-7825-4109-9c09-9a7c0c80762e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:55.300149 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9dcb2f0-7825-4109-9c09-9a7c0c80762e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:55.301056 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9dcb2f0-7825-4109-9c09-9a7c0c80762e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:55.301056 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9dcb2f0-7825-4109-9c09-9a7c0c80762e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:55.367437 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e9dcb2f0-7825-4109-9c09-9a7c0c80762e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:55.375708 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e9dcb2f0-7825-4109-9c09-9a7c0c80762e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1299 microversion: 2.1 time: 0.090602 Sep 09 23:28:55.390467 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 455/882] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:55 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:28:55.521870 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4b64eae5-14be-40a1-81cb-304e67702c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:55.532842 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4b64eae5-14be-40a1-81cb-304e67702c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:55.538837 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4b64eae5-14be-40a1-81cb-304e67702c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:55.540320 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4b64eae5-14be-40a1-81cb-304e67702c08 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.314443 Sep 09 23:28:55.543369 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 428/883] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:55 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:28:56.403644 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-853f80ca-1e4e-425c-87cd-55bd8bfa5760 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:56.405229 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-853f80ca-1e4e-425c-87cd-55bd8bfa5760 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:56.407427 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=8 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:28:56.428381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-853f80ca-1e4e-425c-87cd-55bd8bfa5760 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:56.429100 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-853f80ca-1e4e-425c-87cd-55bd8bfa5760 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:56.429900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-853f80ca-1e4e-425c-87cd-55bd8bfa5760 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:56.430890 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-853f80ca-1e4e-425c-87cd-55bd8bfa5760 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:56.431771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-853f80ca-1e4e-425c-87cd-55bd8bfa5760 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:56.432871 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-853f80ca-1e4e-425c-87cd-55bd8bfa5760 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:56.568756 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-72f9d062-1f0b-4af9-83c9-446a46480094 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:56.569379 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-72f9d062-1f0b-4af9-83c9-446a46480094 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:56.579380 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-72f9d062-1f0b-4af9-83c9-446a46480094 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:56.579876 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-72f9d062-1f0b-4af9-83c9-446a46480094 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:56.580507 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-72f9d062-1f0b-4af9-83c9-446a46480094 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:56.581390 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-72f9d062-1f0b-4af9-83c9-446a46480094 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:56.582013 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-72f9d062-1f0b-4af9-83c9-446a46480094 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:56.582789 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-72f9d062-1f0b-4af9-83c9-446a46480094 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:56.588335 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:28:56.696527 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-853f80ca-1e4e-425c-87cd-55bd8bfa5760 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:56.733618 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-853f80ca-1e4e-425c-87cd-55bd8bfa5760 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1367 microversion: 2.1 time: 0.320623 Sep 09 23:28:56.734677 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 456/884] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:56 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:28:56.847599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-72f9d062-1f0b-4af9-83c9-446a46480094 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:56.858387 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-72f9d062-1f0b-4af9-83c9-446a46480094 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:56.860668 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-72f9d062-1f0b-4af9-83c9-446a46480094 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:56.862129 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-72f9d062-1f0b-4af9-83c9-446a46480094 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.297383 Sep 09 23:28:56.863058 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 429/885] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:56 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:28:57.585491 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-fee4c0b5-5ec5-44ec-abb9-87ce6fab9242 req-7d1266c7-8b93-4056-9a5b-f93a0d4381f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f29a621-0596-49bf-b3bf-99b52cb9aa56", "tag": "bb4482c5-bc5a-4a4b-b35f-25cf0947bbf3"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:28:57.614391 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-fee4c0b5-5ec5-44ec-abb9-87ce6fab9242 req-7d1266c7-8b93-4056-9a5b-f93a0d4381f0 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:57.614391 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-fee4c0b5-5ec5-44ec-abb9-87ce6fab9242 req-7d1266c7-8b93-4056-9a5b-f93a0d4381f0 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:57.614391 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-fee4c0b5-5ec5-44ec-abb9-87ce6fab9242 req-7d1266c7-8b93-4056-9a5b-f93a0d4381f0 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:57.643468 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-fee4c0b5-5ec5-44ec-abb9-87ce6fab9242 req-7d1266c7-8b93-4056-9a5b-f93a0d4381f0 service nova] Creating event network-changed:bb4482c5-bc5a-4a4b-b35f-25cf0947bbf3 for instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 on hv-cinder-85032 Sep 09 23:28:57.651254 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-fee4c0b5-5ec5-44ec-abb9-87ce6fab9242 req-7d1266c7-8b93-4056-9a5b-f93a0d4381f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069264 Sep 09 23:28:57.656519 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 457/886] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:28:57.765480 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-427f3a0e-5d47-4c02-a8e0-19d49182f798 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:57.766112 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-427f3a0e-5d47-4c02-a8e0-19d49182f798 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:57.775865 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-427f3a0e-5d47-4c02-a8e0-19d49182f798 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:57.784242 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-427f3a0e-5d47-4c02-a8e0-19d49182f798 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:57.784242 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-427f3a0e-5d47-4c02-a8e0-19d49182f798 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:57.784242 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-427f3a0e-5d47-4c02-a8e0-19d49182f798 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:57.784242 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-427f3a0e-5d47-4c02-a8e0-19d49182f798 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:57.784993 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-427f3a0e-5d47-4c02-a8e0-19d49182f798 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:57.891926 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5be07b06-c51a-469d-bf11-d67d7c17d20e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:57.893333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5be07b06-c51a-469d-bf11-d67d7c17d20e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:57.907400 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5be07b06-c51a-469d-bf11-d67d7c17d20e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:57.910045 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5be07b06-c51a-469d-bf11-d67d7c17d20e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:57.910790 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5be07b06-c51a-469d-bf11-d67d7c17d20e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:57.913867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5be07b06-c51a-469d-bf11-d67d7c17d20e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:57.916898 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5be07b06-c51a-469d-bf11-d67d7c17d20e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:57.918168 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5be07b06-c51a-469d-bf11-d67d7c17d20e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:58.158589 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-427f3a0e-5d47-4c02-a8e0-19d49182f798 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:58.171357 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-427f3a0e-5d47-4c02-a8e0-19d49182f798 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1367 microversion: 2.1 time: 0.409794 Sep 09 23:28:58.173930 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 430/887] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:57 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1367 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:28:58.225137 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5be07b06-c51a-469d-bf11-d67d7c17d20e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:58.244353 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5be07b06-c51a-469d-bf11-d67d7c17d20e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:58.248162 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5be07b06-c51a-469d-bf11-d67d7c17d20e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:58.250489 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5be07b06-c51a-469d-bf11-d67d7c17d20e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.363280 Sep 09 23:28:58.251734 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 458/888] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:57 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:28:59.202198 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9c3a740b-598e-41a0-a2ae-fdc1457b164b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:59.204039 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9c3a740b-598e-41a0-a2ae-fdc1457b164b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:59.207318 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:28:59.219528 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9c3a740b-598e-41a0-a2ae-fdc1457b164b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:59.225851 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9c3a740b-598e-41a0-a2ae-fdc1457b164b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:59.225851 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9c3a740b-598e-41a0-a2ae-fdc1457b164b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:59.225851 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9c3a740b-598e-41a0-a2ae-fdc1457b164b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:59.225851 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9c3a740b-598e-41a0-a2ae-fdc1457b164b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:59.226449 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9c3a740b-598e-41a0-a2ae-fdc1457b164b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:59.277584 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f8aa8915-d633-4df3-903f-68da0973e043 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:28:59.283520 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f8aa8915-d633-4df3-903f-68da0973e043 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:28:59.304006 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8aa8915-d633-4df3-903f-68da0973e043 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:59.304641 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8aa8915-d633-4df3-903f-68da0973e043 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:59.305161 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8aa8915-d633-4df3-903f-68da0973e043 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:59.305961 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8aa8915-d633-4df3-903f-68da0973e043 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:28:59.306563 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8aa8915-d633-4df3-903f-68da0973e043 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:28:59.307079 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8aa8915-d633-4df3-903f-68da0973e043 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:28:59.626438 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f8aa8915-d633-4df3-903f-68da0973e043 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:59.636424 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f8aa8915-d633-4df3-903f-68da0973e043 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:59.638297 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-f8aa8915-d633-4df3-903f-68da0973e043 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:59.639774 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f8aa8915-d633-4df3-903f-68da0973e043 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.366544 Sep 09 23:28:59.640405 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 459/889] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:28:59 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:28:59.671355 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9c3a740b-598e-41a0-a2ae-fdc1457b164b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:28:59.676792 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9c3a740b-598e-41a0-a2ae-fdc1457b164b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1367 microversion: 2.1 time: 0.479428 Sep 09 23:28:59.704029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 431/890] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:28:59 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1367 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:00.247934 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-672ddcf7-126e-421a-8f02-fe4d08000808 req-b5dd67ae-4e4c-49d6-bd0f-7d3f0745c183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a008236c-707a-4578-912c-07adedbb10cb", "name": "network-vif-plugged", "status": "completed", "tag": "b8c3dd2c-6785-40c3-87d8-e3d4dae738c5"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:29:00.261193 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-672ddcf7-126e-421a-8f02-fe4d08000808 req-b5dd67ae-4e4c-49d6-bd0f-7d3f0745c183 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:00.273783 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-672ddcf7-126e-421a-8f02-fe4d08000808 req-b5dd67ae-4e4c-49d6-bd0f-7d3f0745c183 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:00.274679 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-672ddcf7-126e-421a-8f02-fe4d08000808 req-b5dd67ae-4e4c-49d6-bd0f-7d3f0745c183 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:00.303556 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-672ddcf7-126e-421a-8f02-fe4d08000808 req-b5dd67ae-4e4c-49d6-bd0f-7d3f0745c183 service nova] Creating event network-vif-plugged:b8c3dd2c-6785-40c3-87d8-e3d4dae738c5 for instance a008236c-707a-4578-912c-07adedbb10cb on hv-cinder-85032 Sep 09 23:29:00.310333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-672ddcf7-126e-421a-8f02-fe4d08000808 req-b5dd67ae-4e4c-49d6-bd0f-7d3f0745c183 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065927 Sep 09 23:29:00.310964 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 460/891] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:29:00.671947 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7610f72d-dc5a-4e2b-ba0b-7224a1cf079e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:00.672624 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7610f72d-dc5a-4e2b-ba0b-7224a1cf079e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:00.681405 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7610f72d-dc5a-4e2b-ba0b-7224a1cf079e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:00.682383 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7610f72d-dc5a-4e2b-ba0b-7224a1cf079e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:00.682943 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7610f72d-dc5a-4e2b-ba0b-7224a1cf079e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:00.683791 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7610f72d-dc5a-4e2b-ba0b-7224a1cf079e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:00.684326 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7610f72d-dc5a-4e2b-ba0b-7224a1cf079e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:00.684863 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7610f72d-dc5a-4e2b-ba0b-7224a1cf079e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:00.712762 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5c2a9fd5-638a-4ad6-9c21-c869a604fd78 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:00.717617 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5c2a9fd5-638a-4ad6-9c21-c869a604fd78 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:00.738181 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5c2a9fd5-638a-4ad6-9c21-c869a604fd78 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:00.741502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5c2a9fd5-638a-4ad6-9c21-c869a604fd78 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:00.742381 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5c2a9fd5-638a-4ad6-9c21-c869a604fd78 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:00.743209 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5c2a9fd5-638a-4ad6-9c21-c869a604fd78 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:00.743686 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5c2a9fd5-638a-4ad6-9c21-c869a604fd78 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:00.744125 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5c2a9fd5-638a-4ad6-9c21-c869a604fd78 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:00.873244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7610f72d-dc5a-4e2b-ba0b-7224a1cf079e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:00.883947 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7610f72d-dc5a-4e2b-ba0b-7224a1cf079e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:00.885855 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7610f72d-dc5a-4e2b-ba0b-7224a1cf079e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:00.887336 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7610f72d-dc5a-4e2b-ba0b-7224a1cf079e tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.220145 Sep 09 23:29:00.888868 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 432/892] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:29:00 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:29:00.895579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-02b56e5b-6ddd-435b-a59e-e4cf853607c6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:29:00.897213 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-02b56e5b-6ddd-435b-a59e-e4cf853607c6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:00.904474 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02b56e5b-6ddd-435b-a59e-e4cf853607c6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:00.905325 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02b56e5b-6ddd-435b-a59e-e4cf853607c6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:00.905878 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02b56e5b-6ddd-435b-a59e-e4cf853607c6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:00.906825 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02b56e5b-6ddd-435b-a59e-e4cf853607c6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:00.907697 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02b56e5b-6ddd-435b-a59e-e4cf853607c6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:00.907872 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02b56e5b-6ddd-435b-a59e-e4cf853607c6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:00.934983 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-02b56e5b-6ddd-435b-a59e-e4cf853607c6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lazy-loading 'flavor' on Instance uuid 77d367ef-58a3-46c5-94d6-8723e6cca32b {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:29:01.009785 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5c2a9fd5-638a-4ad6-9c21-c869a604fd78 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:01.018722 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5c2a9fd5-638a-4ad6-9c21-c869a604fd78 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1367 microversion: 2.1 time: 0.319705 Sep 09 23:29:01.019433 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 461/893] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:00 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:01.532385 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-02b56e5b-6ddd-435b-a59e-e4cf853607c6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "POST /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b/action" status: 202 len: 0 microversion: 2.1 time: 0.641859 Sep 09 23:29:01.533375 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 433/894] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 23:29:00 2022] POST /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:29:01.542654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e40fe03a-6fff-4a8d-9258-cb358468d9e5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:01.544041 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e40fe03a-6fff-4a8d-9258-cb358468d9e5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:01.552945 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e40fe03a-6fff-4a8d-9258-cb358468d9e5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:01.553435 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e40fe03a-6fff-4a8d-9258-cb358468d9e5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:01.554668 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e40fe03a-6fff-4a8d-9258-cb358468d9e5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:01.554668 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e40fe03a-6fff-4a8d-9258-cb358468d9e5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:01.555216 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e40fe03a-6fff-4a8d-9258-cb358468d9e5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:01.555646 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e40fe03a-6fff-4a8d-9258-cb358468d9e5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:01.798925 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e40fe03a-6fff-4a8d-9258-cb358468d9e5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:01.811518 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e40fe03a-6fff-4a8d-9258-cb358468d9e5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1566 microversion: 2.1 time: 0.272761 Sep 09 23:29:01.824316 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 462/895] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:01 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1566 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:01.917875 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-36540292-288c-4aac-a6f4-2073695bfdc2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:01.919335 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-36540292-288c-4aac-a6f4-2073695bfdc2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:01.926811 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-36540292-288c-4aac-a6f4-2073695bfdc2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:01.927689 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-36540292-288c-4aac-a6f4-2073695bfdc2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:01.928350 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-36540292-288c-4aac-a6f4-2073695bfdc2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:01.929300 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-36540292-288c-4aac-a6f4-2073695bfdc2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:01.929961 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-36540292-288c-4aac-a6f4-2073695bfdc2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:01.930760 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-36540292-288c-4aac-a6f4-2073695bfdc2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:02.042977 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-12625f25-3abb-49b9-a0fa-36bbd51871c6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:02.044067 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-12625f25-3abb-49b9-a0fa-36bbd51871c6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:02.061356 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12625f25-3abb-49b9-a0fa-36bbd51871c6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:02.061861 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12625f25-3abb-49b9-a0fa-36bbd51871c6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:02.063056 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12625f25-3abb-49b9-a0fa-36bbd51871c6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:02.063451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12625f25-3abb-49b9-a0fa-36bbd51871c6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:02.064101 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12625f25-3abb-49b9-a0fa-36bbd51871c6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:02.064534 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12625f25-3abb-49b9-a0fa-36bbd51871c6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:02.074370 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-36540292-288c-4aac-a6f4-2073695bfdc2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:02.082725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-36540292-288c-4aac-a6f4-2073695bfdc2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:02.084796 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-36540292-288c-4aac-a6f4-2073695bfdc2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:02.086036 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-36540292-288c-4aac-a6f4-2073695bfdc2 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.173579 Sep 09 23:29:02.086642 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 434/896] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:29:01 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:29:02.356402 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-12625f25-3abb-49b9-a0fa-36bbd51871c6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:02.369757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-12625f25-3abb-49b9-a0fa-36bbd51871c6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1367 microversion: 2.1 time: 0.331070 Sep 09 23:29:02.370473 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 463/897] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:02 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:29:02.837272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0a0150a6-20cf-4ebb-a3b3-f6d97755915d tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:02.838051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-0a0150a6-20cf-4ebb-a3b3-f6d97755915d tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:02.844714 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0a0150a6-20cf-4ebb-a3b3-f6d97755915d tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:02.845489 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0a0150a6-20cf-4ebb-a3b3-f6d97755915d tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:02.845935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0a0150a6-20cf-4ebb-a3b3-f6d97755915d tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:02.846677 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0a0150a6-20cf-4ebb-a3b3-f6d97755915d tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:02.847249 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0a0150a6-20cf-4ebb-a3b3-f6d97755915d tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:02.847853 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0a0150a6-20cf-4ebb-a3b3-f6d97755915d tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:03.008595 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-92bdab4d-ba68-49a9-a5a5-cd9eb6f11f5b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Action: 'create', calling method: .version_select at 0x7f908dd3c670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1647096225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgcR4e+wNdtZfaNO/krD0J3OElcRMDF1KPOco4UqySbRacbUg+X/k1LsYzgdegK3zBzuXtaU4a5B7uW3R7CrSFIyECQiFZsOh87aw6DoZvzne9TfbPUWX1PkVtsvpbTnw=="}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:29:03.027734 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-92bdab4d-ba68-49a9-a5a5-cd9eb6f11f5b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Getting quotas for project 8042eb99cd7047d4912b2f4b1e50936e. Resources: {'key_pairs'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:29:03.031741 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-92bdab4d-ba68-49a9-a5a5-cd9eb6f11f5b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Getting quotas for user 8c81c0af6f084b8db165fd51667b3b54 and project 8042eb99cd7047d4912b2f4b1e50936e. Resources: {'key_pairs'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:29:03.040134 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-0a0150a6-20cf-4ebb-a3b3-f6d97755915d tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:03.050968 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-0a0150a6-20cf-4ebb-a3b3-f6d97755915d tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1566 microversion: 2.1 time: 0.217823 Sep 09 23:29:03.051864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 464/898] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:02 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:29:03.112634 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-909e940a-27b9-4a16-b36e-9e262f04d78d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:03.113249 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-909e940a-27b9-4a16-b36e-9e262f04d78d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:03.119108 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-92bdab4d-ba68-49a9-a5a5-cd9eb6f11f5b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.339410 Sep 09 23:29:03.126466 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 435/899] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 23:29:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:29:03.126732 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-909e940a-27b9-4a16-b36e-9e262f04d78d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:03.126732 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-909e940a-27b9-4a16-b36e-9e262f04d78d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:03.126732 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-909e940a-27b9-4a16-b36e-9e262f04d78d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:03.126732 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-909e940a-27b9-4a16-b36e-9e262f04d78d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:03.127041 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-909e940a-27b9-4a16-b36e-9e262f04d78d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:03.127041 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-909e940a-27b9-4a16-b36e-9e262f04d78d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:03.265180 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-909e940a-27b9-4a16-b36e-9e262f04d78d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:03.273813 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-909e940a-27b9-4a16-b36e-9e262f04d78d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:03.275302 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-909e940a-27b9-4a16-b36e-9e262f04d78d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:03.276483 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-909e940a-27b9-4a16-b36e-9e262f04d78d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.168183 Sep 09 23:29:03.277151 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 465/900] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:29:03 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 23:29:03.393859 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7dfefe04-a9e5-4f69-bea8-0c8774729e9e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:03.394524 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7dfefe04-a9e5-4f69-bea8-0c8774729e9e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:03.401716 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7dfefe04-a9e5-4f69-bea8-0c8774729e9e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:03.402202 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7dfefe04-a9e5-4f69-bea8-0c8774729e9e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:03.402670 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7dfefe04-a9e5-4f69-bea8-0c8774729e9e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:03.403363 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7dfefe04-a9e5-4f69-bea8-0c8774729e9e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:03.403822 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7dfefe04-a9e5-4f69-bea8-0c8774729e9e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:03.404248 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7dfefe04-a9e5-4f69-bea8-0c8774729e9e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:03.578194 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7dfefe04-a9e5-4f69-bea8-0c8774729e9e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:03.587156 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7dfefe04-a9e5-4f69-bea8-0c8774729e9e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1367 microversion: 2.1 time: 0.197078 Sep 09 23:29:03.592268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 436/901] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:03 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:04.022335 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-2c5a06ef-4058-4e5a-86ab-18d0f89a5d08 req-4daeec5d-4c64-4d9d-92d3-d0ce3cff0f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f29a621-0596-49bf-b3bf-99b52cb9aa56", "name": "network-vif-plugged", "status": "completed", "tag": "bb4482c5-bc5a-4a4b-b35f-25cf0947bbf3"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:29:04.032429 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-2c5a06ef-4058-4e5a-86ab-18d0f89a5d08 req-4daeec5d-4c64-4d9d-92d3-d0ce3cff0f93 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:04.032913 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-2c5a06ef-4058-4e5a-86ab-18d0f89a5d08 req-4daeec5d-4c64-4d9d-92d3-d0ce3cff0f93 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:04.033346 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-2c5a06ef-4058-4e5a-86ab-18d0f89a5d08 req-4daeec5d-4c64-4d9d-92d3-d0ce3cff0f93 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:04.048082 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-2c5a06ef-4058-4e5a-86ab-18d0f89a5d08 req-4daeec5d-4c64-4d9d-92d3-d0ce3cff0f93 service nova] Creating event network-vif-plugged:bb4482c5-bc5a-4a4b-b35f-25cf0947bbf3 for instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 on hv-cinder-85032 Sep 09 23:29:04.053906 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-2c5a06ef-4058-4e5a-86ab-18d0f89a5d08 req-4daeec5d-4c64-4d9d-92d3-d0ce3cff0f93 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036177 Sep 09 23:29:04.054550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 466/902] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:29:04.076438 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-111013cf-7262-4ff5-aef2-4c6a1c8c6684 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:04.077614 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-111013cf-7262-4ff5-aef2-4c6a1c8c6684 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:04.085474 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-111013cf-7262-4ff5-aef2-4c6a1c8c6684 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:04.087258 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-111013cf-7262-4ff5-aef2-4c6a1c8c6684 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:04.087258 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-111013cf-7262-4ff5-aef2-4c6a1c8c6684 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:04.087758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-111013cf-7262-4ff5-aef2-4c6a1c8c6684 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:04.088384 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-111013cf-7262-4ff5-aef2-4c6a1c8c6684 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:04.088982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-111013cf-7262-4ff5-aef2-4c6a1c8c6684 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:04.278728 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-111013cf-7262-4ff5-aef2-4c6a1c8c6684 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:04.284089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-111013cf-7262-4ff5-aef2-4c6a1c8c6684 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1566 microversion: 2.1 time: 0.211601 Sep 09 23:29:04.284656 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 437/903] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:04 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1566 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:29:04.304836 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5cbedde9-f7b5-4cbf-8007-19b73d6c150f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:04.305537 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5cbedde9-f7b5-4cbf-8007-19b73d6c150f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:04.312645 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5cbedde9-f7b5-4cbf-8007-19b73d6c150f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:04.313133 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5cbedde9-f7b5-4cbf-8007-19b73d6c150f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:04.313570 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5cbedde9-f7b5-4cbf-8007-19b73d6c150f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:04.314269 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5cbedde9-f7b5-4cbf-8007-19b73d6c150f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:04.314752 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5cbedde9-f7b5-4cbf-8007-19b73d6c150f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:04.315177 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5cbedde9-f7b5-4cbf-8007-19b73d6c150f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:04.538657 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5cbedde9-f7b5-4cbf-8007-19b73d6c150f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:04.560592 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5cbedde9-f7b5-4cbf-8007-19b73d6c150f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:04.562063 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5cbedde9-f7b5-4cbf-8007-19b73d6c150f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:04.563420 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5cbedde9-f7b5-4cbf-8007-19b73d6c150f tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1729 microversion: 2.20 time: 0.263678 Sep 09 23:29:04.566453 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 467/904] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:29:04 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1729 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:29:04.611399 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c05c1098-5fd1-4a16-9736-932c591b244e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:04.611944 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c05c1098-5fd1-4a16-9736-932c591b244e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:04.618673 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c05c1098-5fd1-4a16-9736-932c591b244e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:04.619153 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c05c1098-5fd1-4a16-9736-932c591b244e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:04.620757 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c05c1098-5fd1-4a16-9736-932c591b244e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:04.620757 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c05c1098-5fd1-4a16-9736-932c591b244e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:04.620757 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c05c1098-5fd1-4a16-9736-932c591b244e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:04.621162 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c05c1098-5fd1-4a16-9736-932c591b244e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:04.780548 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c05c1098-5fd1-4a16-9736-932c591b244e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:04.788802 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c05c1098-5fd1-4a16-9736-932c591b244e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1367 microversion: 2.1 time: 0.181656 Sep 09 23:29:04.789379 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 438/905] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:04 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:05.307902 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c36b6d13-199f-4e01-bc8f-16bad2157a29 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:05.308616 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-c36b6d13-199f-4e01-bc8f-16bad2157a29 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:05.315439 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c36b6d13-199f-4e01-bc8f-16bad2157a29 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:05.316007 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c36b6d13-199f-4e01-bc8f-16bad2157a29 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:05.316466 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c36b6d13-199f-4e01-bc8f-16bad2157a29 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:05.317165 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c36b6d13-199f-4e01-bc8f-16bad2157a29 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:05.317714 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c36b6d13-199f-4e01-bc8f-16bad2157a29 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:05.318147 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c36b6d13-199f-4e01-bc8f-16bad2157a29 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:05.472711 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-c36b6d13-199f-4e01-bc8f-16bad2157a29 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:05.483452 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-c36b6d13-199f-4e01-bc8f-16bad2157a29 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1566 microversion: 2.1 time: 0.177327 Sep 09 23:29:05.483452 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 468/906] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:05 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:05.590930 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-d8350e4a-b67b-400e-b35f-912baa816502 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:05.592141 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-d8350e4a-b67b-400e-b35f-912baa816502 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:05.599980 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d8350e4a-b67b-400e-b35f-912baa816502 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:05.600652 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d8350e4a-b67b-400e-b35f-912baa816502 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:05.601091 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d8350e4a-b67b-400e-b35f-912baa816502 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:05.601812 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d8350e4a-b67b-400e-b35f-912baa816502 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:05.602265 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d8350e4a-b67b-400e-b35f-912baa816502 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:05.602999 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d8350e4a-b67b-400e-b35f-912baa816502 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:05.751812 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d8350e4a-b67b-400e-b35f-912baa816502 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:05.761612 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d8350e4a-b67b-400e-b35f-912baa816502 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:05.763575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d8350e4a-b67b-400e-b35f-912baa816502 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:05.778510 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-d8350e4a-b67b-400e-b35f-912baa816502 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1716 microversion: 2.20 time: 0.178818 Sep 09 23:29:05.778510 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 439/907] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:29:05 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1716 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:29:05.812446 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-08997f8e-3c04-4bb1-997e-1f6dc00e7e89 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:05.813114 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-08997f8e-3c04-4bb1-997e-1f6dc00e7e89 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:05.819306 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08997f8e-3c04-4bb1-997e-1f6dc00e7e89 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:05.819803 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08997f8e-3c04-4bb1-997e-1f6dc00e7e89 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:05.820249 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08997f8e-3c04-4bb1-997e-1f6dc00e7e89 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:05.820947 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08997f8e-3c04-4bb1-997e-1f6dc00e7e89 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:05.821408 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08997f8e-3c04-4bb1-997e-1f6dc00e7e89 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:05.821837 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08997f8e-3c04-4bb1-997e-1f6dc00e7e89 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:05.961004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-08997f8e-3c04-4bb1-997e-1f6dc00e7e89 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:05.969302 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-08997f8e-3c04-4bb1-997e-1f6dc00e7e89 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1557 microversion: 2.1 time: 0.160666 Sep 09 23:29:05.982882 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 469/908] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:05 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1557 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:05.994640 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-311bbde1-07c2-4dd6-a936-b05d993b3260 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:05.995155 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-311bbde1-07c2-4dd6-a936-b05d993b3260 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:06.001345 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-311bbde1-07c2-4dd6-a936-b05d993b3260 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:06.001859 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-311bbde1-07c2-4dd6-a936-b05d993b3260 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:06.002288 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-311bbde1-07c2-4dd6-a936-b05d993b3260 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:06.003026 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-311bbde1-07c2-4dd6-a936-b05d993b3260 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:06.003487 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-311bbde1-07c2-4dd6-a936-b05d993b3260 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:06.003917 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-311bbde1-07c2-4dd6-a936-b05d993b3260 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:06.087642 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-311bbde1-07c2-4dd6-a936-b05d993b3260 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096847 Sep 09 23:29:06.088256 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 440/909] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 23:29:05 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:29:06.506891 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-745cfd14-00e2-42a2-96c9-81cb174fe157 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:06.508165 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-745cfd14-00e2-42a2-96c9-81cb174fe157 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:06.515551 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-745cfd14-00e2-42a2-96c9-81cb174fe157 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:06.516044 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-745cfd14-00e2-42a2-96c9-81cb174fe157 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:06.516482 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-745cfd14-00e2-42a2-96c9-81cb174fe157 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:06.517187 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-745cfd14-00e2-42a2-96c9-81cb174fe157 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:06.517646 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-745cfd14-00e2-42a2-96c9-81cb174fe157 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:06.518158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-745cfd14-00e2-42a2-96c9-81cb174fe157 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:06.530328 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=100 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:29:06.737231 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-745cfd14-00e2-42a2-96c9-81cb174fe157 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:06.746109 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-745cfd14-00e2-42a2-96c9-81cb174fe157 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1566 microversion: 2.1 time: 0.243318 Sep 09 23:29:06.746965 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 470/910] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:06 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1566 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:07.322809 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-bb20048e-00df-4f75-8331-1642ea0c3aff req-58120cdf-2b7c-44a4-83bb-eb10d46d2ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f29a621-0596-49bf-b3bf-99b52cb9aa56", "tag": "bb4482c5-bc5a-4a4b-b35f-25cf0947bbf3"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:29:07.336436 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-bb20048e-00df-4f75-8331-1642ea0c3aff req-58120cdf-2b7c-44a4-83bb-eb10d46d2ea0 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:07.337072 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-bb20048e-00df-4f75-8331-1642ea0c3aff req-58120cdf-2b7c-44a4-83bb-eb10d46d2ea0 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:07.337688 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-bb20048e-00df-4f75-8331-1642ea0c3aff req-58120cdf-2b7c-44a4-83bb-eb10d46d2ea0 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:07.354012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-bb20048e-00df-4f75-8331-1642ea0c3aff req-58120cdf-2b7c-44a4-83bb-eb10d46d2ea0 service nova] Creating event network-changed:bb4482c5-bc5a-4a4b-b35f-25cf0947bbf3 for instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 on hv-cinder-85032 Sep 09 23:29:07.359962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-bb20048e-00df-4f75-8331-1642ea0c3aff req-58120cdf-2b7c-44a4-83bb-eb10d46d2ea0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042841 Sep 09 23:29:07.360990 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 441/911] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:29:07.771010 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ad159cfc-e31d-42db-a9ff-519794717c5f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:07.772342 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ad159cfc-e31d-42db-a9ff-519794717c5f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:07.779639 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ad159cfc-e31d-42db-a9ff-519794717c5f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:07.780688 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ad159cfc-e31d-42db-a9ff-519794717c5f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:07.781369 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ad159cfc-e31d-42db-a9ff-519794717c5f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:07.782327 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ad159cfc-e31d-42db-a9ff-519794717c5f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:07.783037 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ad159cfc-e31d-42db-a9ff-519794717c5f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:07.783833 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ad159cfc-e31d-42db-a9ff-519794717c5f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:08.015823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ad159cfc-e31d-42db-a9ff-519794717c5f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:08.025443 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ad159cfc-e31d-42db-a9ff-519794717c5f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1566 microversion: 2.1 time: 0.258879 Sep 09 23:29:08.026845 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 471/912] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:07 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1566 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:29:09.050199 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-dda2de52-c0dd-42c5-ae1d-5932f96c511c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:09.051225 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-dda2de52-c0dd-42c5-ae1d-5932f96c511c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:09.059347 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dda2de52-c0dd-42c5-ae1d-5932f96c511c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:09.059842 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dda2de52-c0dd-42c5-ae1d-5932f96c511c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:09.060286 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dda2de52-c0dd-42c5-ae1d-5932f96c511c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:09.061349 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dda2de52-c0dd-42c5-ae1d-5932f96c511c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:09.063088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dda2de52-c0dd-42c5-ae1d-5932f96c511c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:09.063528 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dda2de52-c0dd-42c5-ae1d-5932f96c511c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:09.215890 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-dda2de52-c0dd-42c5-ae1d-5932f96c511c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:09.224516 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-dda2de52-c0dd-42c5-ae1d-5932f96c511c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1566 microversion: 2.1 time: 0.178360 Sep 09 23:29:09.225355 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 442/913] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:09 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:10.248134 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c6562326-d003-41d8-af02-1d25bce922d7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:10.248762 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-c6562326-d003-41d8-af02-1d25bce922d7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:10.255296 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c6562326-d003-41d8-af02-1d25bce922d7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:10.255781 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c6562326-d003-41d8-af02-1d25bce922d7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:10.256856 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c6562326-d003-41d8-af02-1d25bce922d7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:10.257556 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c6562326-d003-41d8-af02-1d25bce922d7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:10.258009 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c6562326-d003-41d8-af02-1d25bce922d7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:10.258488 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c6562326-d003-41d8-af02-1d25bce922d7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:10.393611 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-c6562326-d003-41d8-af02-1d25bce922d7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:10.402250 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-c6562326-d003-41d8-af02-1d25bce922d7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1566 microversion: 2.1 time: 0.157939 Sep 09 23:29:10.402907 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 472/914] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:10 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:11.426404 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1a4535ae-f241-4f3f-90cc-dda4aace5662 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:11.427129 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-1a4535ae-f241-4f3f-90cc-dda4aace5662 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:11.435971 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1a4535ae-f241-4f3f-90cc-dda4aace5662 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:11.436455 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1a4535ae-f241-4f3f-90cc-dda4aace5662 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:11.436888 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1a4535ae-f241-4f3f-90cc-dda4aace5662 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:11.437589 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1a4535ae-f241-4f3f-90cc-dda4aace5662 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:11.438038 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1a4535ae-f241-4f3f-90cc-dda4aace5662 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:11.438488 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1a4535ae-f241-4f3f-90cc-dda4aace5662 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:11.578888 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1a4535ae-f241-4f3f-90cc-dda4aace5662 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:11.587476 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-1a4535ae-f241-4f3f-90cc-dda4aace5662 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1566 microversion: 2.1 time: 0.166212 Sep 09 23:29:11.588037 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 443/915] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:11 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:12.612617 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a223328f-f119-41c9-93d1-b5c716e378d3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:12.614209 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a223328f-f119-41c9-93d1-b5c716e378d3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:12.623927 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a223328f-f119-41c9-93d1-b5c716e378d3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:12.624424 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a223328f-f119-41c9-93d1-b5c716e378d3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:12.624856 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a223328f-f119-41c9-93d1-b5c716e378d3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:12.625556 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a223328f-f119-41c9-93d1-b5c716e378d3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:12.626011 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a223328f-f119-41c9-93d1-b5c716e378d3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:12.626466 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a223328f-f119-41c9-93d1-b5c716e378d3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:12.780214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a223328f-f119-41c9-93d1-b5c716e378d3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:12.780214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a223328f-f119-41c9-93d1-b5c716e378d3 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1566 microversion: 2.1 time: 0.172040 Sep 09 23:29:12.780483 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 473/916] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:12 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:13.802145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-37a2afa5-da3c-43fd-b309-dcfa72ddd01a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:13.802730 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-37a2afa5-da3c-43fd-b309-dcfa72ddd01a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:13.805756 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=4 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:29:13.811782 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37a2afa5-da3c-43fd-b309-dcfa72ddd01a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:13.812818 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37a2afa5-da3c-43fd-b309-dcfa72ddd01a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:13.813685 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37a2afa5-da3c-43fd-b309-dcfa72ddd01a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:13.817021 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37a2afa5-da3c-43fd-b309-dcfa72ddd01a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:13.817021 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37a2afa5-da3c-43fd-b309-dcfa72ddd01a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:13.817021 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-37a2afa5-da3c-43fd-b309-dcfa72ddd01a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:13.955299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-37a2afa5-da3c-43fd-b309-dcfa72ddd01a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:13.965312 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-37a2afa5-da3c-43fd-b309-dcfa72ddd01a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1566 microversion: 2.1 time: 0.166919 Sep 09 23:29:13.971583 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 444/917] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:13 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:14.989706 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-73a24ba5-e275-4039-b946-e81ee51306e7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:14.990446 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-73a24ba5-e275-4039-b946-e81ee51306e7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:15.000342 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-73a24ba5-e275-4039-b946-e81ee51306e7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:15.002203 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-73a24ba5-e275-4039-b946-e81ee51306e7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:15.002757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-73a24ba5-e275-4039-b946-e81ee51306e7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:15.003526 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-73a24ba5-e275-4039-b946-e81ee51306e7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:15.003988 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-73a24ba5-e275-4039-b946-e81ee51306e7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:15.004418 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-73a24ba5-e275-4039-b946-e81ee51306e7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:15.160560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-73a24ba5-e275-4039-b946-e81ee51306e7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:15.168617 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-73a24ba5-e275-4039-b946-e81ee51306e7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1566 microversion: 2.1 time: 0.183139 Sep 09 23:29:15.169290 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 474/918] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:14 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:16.192770 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e94448ef-9d0f-4b67-8e01-d7db2b86c2a7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:16.193420 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e94448ef-9d0f-4b67-8e01-d7db2b86c2a7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:16.201137 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e94448ef-9d0f-4b67-8e01-d7db2b86c2a7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:16.204702 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e94448ef-9d0f-4b67-8e01-d7db2b86c2a7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:16.204702 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e94448ef-9d0f-4b67-8e01-d7db2b86c2a7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:16.204702 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e94448ef-9d0f-4b67-8e01-d7db2b86c2a7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:16.204702 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e94448ef-9d0f-4b67-8e01-d7db2b86c2a7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:16.205031 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e94448ef-9d0f-4b67-8e01-d7db2b86c2a7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:16.352282 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e94448ef-9d0f-4b67-8e01-d7db2b86c2a7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:16.355780 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:29:16.362576 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e94448ef-9d0f-4b67-8e01-d7db2b86c2a7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1507 microversion: 2.1 time: 0.173537 Sep 09 23:29:16.363275 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 445/919] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:16 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:16.388746 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-28171b78-142d-48ed-905b-673bb8b2812a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:29:16.389340 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-28171b78-142d-48ed-905b-673bb8b2812a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:16.395795 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-28171b78-142d-48ed-905b-673bb8b2812a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:16.396281 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-28171b78-142d-48ed-905b-673bb8b2812a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:16.396716 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-28171b78-142d-48ed-905b-673bb8b2812a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:16.397412 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-28171b78-142d-48ed-905b-673bb8b2812a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:16.397867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-28171b78-142d-48ed-905b-673bb8b2812a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:16.398296 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-28171b78-142d-48ed-905b-673bb8b2812a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:16.430722 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-28171b78-142d-48ed-905b-673bb8b2812a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121059) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 23:29:16.683944 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-28171b78-142d-48ed-905b-673bb8b2812a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "POST /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b/action" status: 202 len: 0 microversion: 2.1 time: 0.299226 Sep 09 23:29:16.684553 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 475/920] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 23:29:16 2022] POST /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 23:29:16.699086 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a9773c55-4767-45a3-8f63-93686a6c93b6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:16.700066 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a9773c55-4767-45a3-8f63-93686a6c93b6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:16.707393 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9773c55-4767-45a3-8f63-93686a6c93b6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:16.707877 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9773c55-4767-45a3-8f63-93686a6c93b6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:16.708504 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9773c55-4767-45a3-8f63-93686a6c93b6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:16.709221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9773c55-4767-45a3-8f63-93686a6c93b6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:16.709793 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9773c55-4767-45a3-8f63-93686a6c93b6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:16.710195 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9773c55-4767-45a3-8f63-93686a6c93b6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:16.846203 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a9773c55-4767-45a3-8f63-93686a6c93b6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:16.854217 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a9773c55-4767-45a3-8f63-93686a6c93b6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1515 microversion: 2.1 time: 0.163133 Sep 09 23:29:16.854847 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 446/921] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:16 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:17.880849 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-43db4601-6fbe-46e2-9ba9-6747042e4b56 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:17.881525 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-43db4601-6fbe-46e2-9ba9-6747042e4b56 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:17.887798 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-43db4601-6fbe-46e2-9ba9-6747042e4b56 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:17.888315 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-43db4601-6fbe-46e2-9ba9-6747042e4b56 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:17.888815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-43db4601-6fbe-46e2-9ba9-6747042e4b56 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:17.889541 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-43db4601-6fbe-46e2-9ba9-6747042e4b56 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:17.890204 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-43db4601-6fbe-46e2-9ba9-6747042e4b56 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:17.890777 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-43db4601-6fbe-46e2-9ba9-6747042e4b56 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:17.989797 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-87c8deb6-432a-465c-95c6-3878ebdfbf94 req-ce603cbc-74de-42e1-8319-e007c0e2b815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d367ef-58a3-46c5-94d6-8723e6cca32b", "name": "network-vif-unplugged", "status": "completed", "tag": "c92b2495-b9d4-4026-960c-2b98f517147e"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:29:18.001178 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-87c8deb6-432a-465c-95c6-3878ebdfbf94 req-ce603cbc-74de-42e1-8319-e007c0e2b815 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:18.001709 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-87c8deb6-432a-465c-95c6-3878ebdfbf94 req-ce603cbc-74de-42e1-8319-e007c0e2b815 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:18.002170 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-87c8deb6-432a-465c-95c6-3878ebdfbf94 req-ce603cbc-74de-42e1-8319-e007c0e2b815 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:18.014820 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.compute.server_external_events [req-87c8deb6-432a-465c-95c6-3878ebdfbf94 req-ce603cbc-74de-42e1-8319-e007c0e2b815 service nova] Unable to find a host for instance 77d367ef-58a3-46c5-94d6-8723e6cca32b. Dropping event network-vif-unplugged {{(pid=121058) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 23:29:18.015701 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-87c8deb6-432a-465c-95c6-3878ebdfbf94 req-ce603cbc-74de-42e1-8319-e007c0e2b815 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030518 Sep 09 23:29:18.016292 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 447/922] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 23:29:18.094583 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-43db4601-6fbe-46e2-9ba9-6747042e4b56 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:18.102806 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-43db4601-6fbe-46e2-9ba9-6747042e4b56 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1517 microversion: 2.1 time: 0.227214 Sep 09 23:29:18.117111 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 476/923] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:17 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1517 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:19.127730 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-584ed940-593b-4a55-9856-1c87b2098c73 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:19.128637 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-584ed940-593b-4a55-9856-1c87b2098c73 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:19.135609 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-584ed940-593b-4a55-9856-1c87b2098c73 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:19.136159 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-584ed940-593b-4a55-9856-1c87b2098c73 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:19.136744 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-584ed940-593b-4a55-9856-1c87b2098c73 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:19.137504 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-584ed940-593b-4a55-9856-1c87b2098c73 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:19.138023 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-584ed940-593b-4a55-9856-1c87b2098c73 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:19.138546 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-584ed940-593b-4a55-9856-1c87b2098c73 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:19.272344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-584ed940-593b-4a55-9856-1c87b2098c73 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:19.280746 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-584ed940-593b-4a55-9856-1c87b2098c73 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1573 microversion: 2.1 time: 0.157391 Sep 09 23:29:19.281406 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 448/924] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:19 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:20.305393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-48e73f9d-6dfa-42ff-9193-03e760b2d67e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:20.306778 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-48e73f9d-6dfa-42ff-9193-03e760b2d67e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:20.313248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-48e73f9d-6dfa-42ff-9193-03e760b2d67e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:20.313740 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-48e73f9d-6dfa-42ff-9193-03e760b2d67e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:20.314185 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-48e73f9d-6dfa-42ff-9193-03e760b2d67e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:20.314921 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-48e73f9d-6dfa-42ff-9193-03e760b2d67e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:20.315387 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-48e73f9d-6dfa-42ff-9193-03e760b2d67e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:20.315819 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-48e73f9d-6dfa-42ff-9193-03e760b2d67e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:20.452879 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-48e73f9d-6dfa-42ff-9193-03e760b2d67e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:20.460551 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-48e73f9d-6dfa-42ff-9193-03e760b2d67e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1573 microversion: 2.1 time: 0.159211 Sep 09 23:29:20.461113 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 477/925] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:20 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:21.484806 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-65c47e86-2011-41d2-8d36-08907e34bd4c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:21.485718 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-65c47e86-2011-41d2-8d36-08907e34bd4c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:21.492178 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65c47e86-2011-41d2-8d36-08907e34bd4c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:21.492648 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65c47e86-2011-41d2-8d36-08907e34bd4c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:21.493164 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65c47e86-2011-41d2-8d36-08907e34bd4c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:21.494231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65c47e86-2011-41d2-8d36-08907e34bd4c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:21.494724 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65c47e86-2011-41d2-8d36-08907e34bd4c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:21.497278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-65c47e86-2011-41d2-8d36-08907e34bd4c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:21.630277 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-65c47e86-2011-41d2-8d36-08907e34bd4c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:21.638256 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-65c47e86-2011-41d2-8d36-08907e34bd4c tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1573 microversion: 2.1 time: 0.157402 Sep 09 23:29:21.640600 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 449/926] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:21 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:29:22.662462 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-152c83c3-4e96-40ac-a521-20a08a9cc957 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:22.663072 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-152c83c3-4e96-40ac-a521-20a08a9cc957 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:22.669389 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-152c83c3-4e96-40ac-a521-20a08a9cc957 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:22.669870 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-152c83c3-4e96-40ac-a521-20a08a9cc957 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:22.670307 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-152c83c3-4e96-40ac-a521-20a08a9cc957 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:22.671027 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-152c83c3-4e96-40ac-a521-20a08a9cc957 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:22.671480 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-152c83c3-4e96-40ac-a521-20a08a9cc957 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:22.671901 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-152c83c3-4e96-40ac-a521-20a08a9cc957 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:22.790005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1951410541", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1647096225", "security_groups": [{"name": "tempest-secgroup-smoke-1193112495"}], "block_device_mapping_v2": [{"uuid": "6df02f2b-70bb-4c63-88fd-39712b1e8ef8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7fd7062d-e427-4fda-80b7-f6a7278968d0"}]}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:29:22.803595 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-152c83c3-4e96-40ac-a521-20a08a9cc957 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:22.812425 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-152c83c3-4e96-40ac-a521-20a08a9cc957 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1573 microversion: 2.1 time: 0.153877 Sep 09 23:29:22.813095 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 478/927] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:22 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:22.912544 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.network.neutron [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] validate_networks() for [('7fd7062d-e427-4fda-80b7-f6a7278968d0', None, None, None, None, None)] {{(pid=121058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:29:23.281976 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Flavor limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:29:23.282444 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Image limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:29:23.282922 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Flavor pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:29:23.283334 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Image pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:29:23.283747 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:29:23.292627 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:23.293170 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:23.300169 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:23.300169 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:23.300169 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:23.300169 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:23.312444 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Getting quotas for project 8042eb99cd7047d4912b2f4b1e50936e. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:29:23.316353 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Getting quotas for user 8c81c0af6f084b8db165fd51667b3b54 and project 8042eb99cd7047d4912b2f4b1e50936e. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:29:23.380038 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Going to run 1 instances... {{(pid=121058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:29:23.380038 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6df02f2b-70bb-4c63-88fd-39712b1e8ef8',volume_size=None,volume_type=None)] {{(pid=121058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:29:23.785841 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a9ababc2-3925-4155-b7d6-a9e8c5afa750 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.999679 Sep 09 23:29:23.786510 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 450/928] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:29:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 23:29:23.797676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-94698b89-0144-473e-8d66-ef005c7cf6a3 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:23.798297 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-94698b89-0144-473e-8d66-ef005c7cf6a3 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:23.836110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3ba6167d-bcf0-4148-9bc9-1bf2139c894e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:23.836835 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3ba6167d-bcf0-4148-9bc9-1bf2139c894e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:23.843631 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ba6167d-bcf0-4148-9bc9-1bf2139c894e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:23.844192 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ba6167d-bcf0-4148-9bc9-1bf2139c894e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:23.844699 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ba6167d-bcf0-4148-9bc9-1bf2139c894e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:23.845460 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ba6167d-bcf0-4148-9bc9-1bf2139c894e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:23.846122 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ba6167d-bcf0-4148-9bc9-1bf2139c894e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:23.846674 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ba6167d-bcf0-4148-9bc9-1bf2139c894e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:23.855432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-94698b89-0144-473e-8d66-ef005c7cf6a3 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:23.862830 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-94698b89-0144-473e-8d66-ef005c7cf6a3 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1095 microversion: 2.1 time: 0.069043 Sep 09 23:29:23.863621 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 479/929] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:23 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:23.982207 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3ba6167d-bcf0-4148-9bc9-1bf2139c894e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:23.990542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3ba6167d-bcf0-4148-9bc9-1bf2139c894e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1573 microversion: 2.1 time: 0.158350 Sep 09 23:29:23.991111 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 451/930] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:23 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:24.885937 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e3c6c8b6-f05e-467e-bf7b-5c632d33229b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:24.886510 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e3c6c8b6-f05e-467e-bf7b-5c632d33229b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:24.893585 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3c6c8b6-f05e-467e-bf7b-5c632d33229b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:24.894280 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3c6c8b6-f05e-467e-bf7b-5c632d33229b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:24.894544 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3c6c8b6-f05e-467e-bf7b-5c632d33229b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:24.895242 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3c6c8b6-f05e-467e-bf7b-5c632d33229b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:24.895704 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3c6c8b6-f05e-467e-bf7b-5c632d33229b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:24.896132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3c6c8b6-f05e-467e-bf7b-5c632d33229b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:24.959522 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e3c6c8b6-f05e-467e-bf7b-5c632d33229b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:24.967565 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e3c6c8b6-f05e-467e-bf7b-5c632d33229b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1145 microversion: 2.1 time: 0.086408 Sep 09 23:29:24.968122 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 480/931] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:24 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:25.013793 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3204ecf9-184e-4235-83d4-b52ae2356570 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:25.014455 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3204ecf9-184e-4235-83d4-b52ae2356570 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:25.020899 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3204ecf9-184e-4235-83d4-b52ae2356570 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:25.021393 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3204ecf9-184e-4235-83d4-b52ae2356570 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:25.021865 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3204ecf9-184e-4235-83d4-b52ae2356570 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:25.022606 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3204ecf9-184e-4235-83d4-b52ae2356570 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:25.023068 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3204ecf9-184e-4235-83d4-b52ae2356570 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:25.023500 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3204ecf9-184e-4235-83d4-b52ae2356570 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:25.161700 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3204ecf9-184e-4235-83d4-b52ae2356570 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:25.169709 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3204ecf9-184e-4235-83d4-b52ae2356570 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1573 microversion: 2.1 time: 0.159855 Sep 09 23:29:25.170289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 452/932] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:25 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:29:25.990459 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ba38e8c7-63af-4f92-995f-ec70eeffb569 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:25.991081 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ba38e8c7-63af-4f92-995f-ec70eeffb569 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:25.997637 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ba38e8c7-63af-4f92-995f-ec70eeffb569 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:25.998126 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ba38e8c7-63af-4f92-995f-ec70eeffb569 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:25.998630 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ba38e8c7-63af-4f92-995f-ec70eeffb569 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:25.999356 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ba38e8c7-63af-4f92-995f-ec70eeffb569 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:25.999826 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ba38e8c7-63af-4f92-995f-ec70eeffb569 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:26.000259 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ba38e8c7-63af-4f92-995f-ec70eeffb569 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:26.064140 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ba38e8c7-63af-4f92-995f-ec70eeffb569 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:26.071888 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ba38e8c7-63af-4f92-995f-ec70eeffb569 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1193 microversion: 2.1 time: 0.085339 Sep 09 23:29:26.072457 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 481/933] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:25 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:26.196700 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9eef989b-ee8b-4a69-82c8-405646788f1f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:26.197343 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9eef989b-ee8b-4a69-82c8-405646788f1f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:26.204866 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9eef989b-ee8b-4a69-82c8-405646788f1f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:26.205354 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9eef989b-ee8b-4a69-82c8-405646788f1f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:26.205786 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9eef989b-ee8b-4a69-82c8-405646788f1f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:26.206514 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9eef989b-ee8b-4a69-82c8-405646788f1f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:26.206971 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9eef989b-ee8b-4a69-82c8-405646788f1f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:26.207397 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9eef989b-ee8b-4a69-82c8-405646788f1f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:26.336285 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9eef989b-ee8b-4a69-82c8-405646788f1f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:26.345343 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9eef989b-ee8b-4a69-82c8-405646788f1f tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1573 microversion: 2.1 time: 0.152566 Sep 09 23:29:26.345913 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 453/934] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:26 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:27.095725 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4a1a71c7-0ec0-45ab-b793-58360cd3e19e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:27.096326 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4a1a71c7-0ec0-45ab-b793-58360cd3e19e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:27.102597 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a1a71c7-0ec0-45ab-b793-58360cd3e19e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:27.103107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a1a71c7-0ec0-45ab-b793-58360cd3e19e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:27.103587 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a1a71c7-0ec0-45ab-b793-58360cd3e19e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:27.104355 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a1a71c7-0ec0-45ab-b793-58360cd3e19e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:27.104821 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a1a71c7-0ec0-45ab-b793-58360cd3e19e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:27.105445 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4a1a71c7-0ec0-45ab-b793-58360cd3e19e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:27.179103 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4a1a71c7-0ec0-45ab-b793-58360cd3e19e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:27.189168 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4a1a71c7-0ec0-45ab-b793-58360cd3e19e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1211 microversion: 2.1 time: 0.097231 Sep 09 23:29:27.190735 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 482/935] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:27 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:27.373529 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-d74eeca6-8192-4fd3-8bc8-06f61db0f511 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:27.377393 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-d74eeca6-8192-4fd3-8bc8-06f61db0f511 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:27.384685 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d74eeca6-8192-4fd3-8bc8-06f61db0f511 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:27.385926 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d74eeca6-8192-4fd3-8bc8-06f61db0f511 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:27.386441 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d74eeca6-8192-4fd3-8bc8-06f61db0f511 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:27.387625 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d74eeca6-8192-4fd3-8bc8-06f61db0f511 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:27.388271 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d74eeca6-8192-4fd3-8bc8-06f61db0f511 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:27.389155 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-d74eeca6-8192-4fd3-8bc8-06f61db0f511 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:27.551936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-d74eeca6-8192-4fd3-8bc8-06f61db0f511 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:27.560609 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-d74eeca6-8192-4fd3-8bc8-06f61db0f511 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1573 microversion: 2.1 time: 0.193748 Sep 09 23:29:27.561191 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 454/936] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:27 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1573 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:28.214037 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3a826247-1b69-49d6-bf07-623f4b77d1cf tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:28.214679 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3a826247-1b69-49d6-bf07-623f4b77d1cf tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:28.218495 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:29:28.222090 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a826247-1b69-49d6-bf07-623f4b77d1cf tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:28.222604 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a826247-1b69-49d6-bf07-623f4b77d1cf tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:28.223043 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a826247-1b69-49d6-bf07-623f4b77d1cf tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:28.223739 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a826247-1b69-49d6-bf07-623f4b77d1cf tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:28.224335 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a826247-1b69-49d6-bf07-623f4b77d1cf tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:28.224762 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3a826247-1b69-49d6-bf07-623f4b77d1cf tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:28.386974 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3a826247-1b69-49d6-bf07-623f4b77d1cf tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:28.394552 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3a826247-1b69-49d6-bf07-623f4b77d1cf tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1267 microversion: 2.1 time: 0.184853 Sep 09 23:29:28.395111 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 483/937] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:28 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:28.415522 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-d2f77501-8f1a-4f47-add5-720f64316198 req-20978031-95db-4da8-bb75-3e83059f2361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f980e0-fd89-4da8-a658-577721144b73", "tag": "ce012a55-46cc-4eaf-94c4-5c066c18f1a2"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:29:28.427008 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-d2f77501-8f1a-4f47-add5-720f64316198 req-20978031-95db-4da8-bb75-3e83059f2361 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:28.427740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-d2f77501-8f1a-4f47-add5-720f64316198 req-20978031-95db-4da8-bb75-3e83059f2361 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:28.428173 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-d2f77501-8f1a-4f47-add5-720f64316198 req-20978031-95db-4da8-bb75-3e83059f2361 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:28.440000 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-d2f77501-8f1a-4f47-add5-720f64316198 req-20978031-95db-4da8-bb75-3e83059f2361 service nova] Creating event network-changed:ce012a55-46cc-4eaf-94c4-5c066c18f1a2 for instance 47f980e0-fd89-4da8-a658-577721144b73 on hv-cinder-85032 Sep 09 23:29:28.444963 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-d2f77501-8f1a-4f47-add5-720f64316198 req-20978031-95db-4da8-bb75-3e83059f2361 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033225 Sep 09 23:29:28.446516 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 455/938] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:29:28.584413 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-54801558-3ac0-4ac8-8576-d520789347fe tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:28.585369 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-54801558-3ac0-4ac8-8576-d520789347fe tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:28.592154 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54801558-3ac0-4ac8-8576-d520789347fe tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:28.592887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54801558-3ac0-4ac8-8576-d520789347fe tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:28.593507 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54801558-3ac0-4ac8-8576-d520789347fe tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:28.594403 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54801558-3ac0-4ac8-8576-d520789347fe tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:28.595151 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54801558-3ac0-4ac8-8576-d520789347fe tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:28.595749 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54801558-3ac0-4ac8-8576-d520789347fe tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:28.809247 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-54801558-3ac0-4ac8-8576-d520789347fe tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:28.817133 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-54801558-3ac0-4ac8-8576-d520789347fe tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1573 microversion: 2.1 time: 0.236607 Sep 09 23:29:28.817815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 484/939] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:28 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1573 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:29.419638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ab131034-fbc4-4317-8d27-14ce2d662b1b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:29.420343 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ab131034-fbc4-4317-8d27-14ce2d662b1b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:29.427857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ab131034-fbc4-4317-8d27-14ce2d662b1b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:29.428341 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ab131034-fbc4-4317-8d27-14ce2d662b1b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:29.428775 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ab131034-fbc4-4317-8d27-14ce2d662b1b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:29.429467 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ab131034-fbc4-4317-8d27-14ce2d662b1b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:29.429916 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ab131034-fbc4-4317-8d27-14ce2d662b1b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:29.430387 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ab131034-fbc4-4317-8d27-14ce2d662b1b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:29.562146 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ab131034-fbc4-4317-8d27-14ce2d662b1b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:29.569844 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ab131034-fbc4-4317-8d27-14ce2d662b1b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1267 microversion: 2.1 time: 0.155128 Sep 09 23:29:29.570436 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 456/940] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:29 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:29.842541 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-11285f49-fc91-4db5-ba9b-e1f7664146a5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:29.843182 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-11285f49-fc91-4db5-ba9b-e1f7664146a5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:29.849562 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-11285f49-fc91-4db5-ba9b-e1f7664146a5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:29.850049 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-11285f49-fc91-4db5-ba9b-e1f7664146a5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:29.850524 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-11285f49-fc91-4db5-ba9b-e1f7664146a5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:29.851217 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-11285f49-fc91-4db5-ba9b-e1f7664146a5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:29.851704 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-11285f49-fc91-4db5-ba9b-e1f7664146a5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:29.852130 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-11285f49-fc91-4db5-ba9b-e1f7664146a5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:29.991496 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-11285f49-fc91-4db5-ba9b-e1f7664146a5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:29.999446 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-11285f49-fc91-4db5-ba9b-e1f7664146a5 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1573 microversion: 2.1 time: 0.162279 Sep 09 23:29:30.000014 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 485/941] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:29 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:30.102323 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-60fa5c40-601b-41a5-93df-9cc0327857ae req-a7fb2fef-ad38-430d-9daa-98f1185820f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d367ef-58a3-46c5-94d6-8723e6cca32b", "name": "network-vif-plugged", "status": "completed", "tag": "c92b2495-b9d4-4026-960c-2b98f517147e"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:29:30.111822 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-60fa5c40-601b-41a5-93df-9cc0327857ae req-a7fb2fef-ad38-430d-9daa-98f1185820f8 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:30.116629 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-60fa5c40-601b-41a5-93df-9cc0327857ae req-a7fb2fef-ad38-430d-9daa-98f1185820f8 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:30.116629 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-60fa5c40-601b-41a5-93df-9cc0327857ae req-a7fb2fef-ad38-430d-9daa-98f1185820f8 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:30.123512 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-60fa5c40-601b-41a5-93df-9cc0327857ae req-a7fb2fef-ad38-430d-9daa-98f1185820f8 service nova] Creating event network-vif-plugged:c92b2495-b9d4-4026-960c-2b98f517147e for instance 77d367ef-58a3-46c5-94d6-8723e6cca32b on hv-cinder-85032 Sep 09 23:29:30.128276 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-60fa5c40-601b-41a5-93df-9cc0327857ae req-a7fb2fef-ad38-430d-9daa-98f1185820f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029671 Sep 09 23:29:30.128844 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 457/942] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:29:30.592528 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-78ac093c-ad49-46e5-b56d-d91381eb67d4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:30.593140 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-78ac093c-ad49-46e5-b56d-d91381eb67d4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:30.599124 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-78ac093c-ad49-46e5-b56d-d91381eb67d4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:30.599603 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-78ac093c-ad49-46e5-b56d-d91381eb67d4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:30.600041 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-78ac093c-ad49-46e5-b56d-d91381eb67d4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:30.600723 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-78ac093c-ad49-46e5-b56d-d91381eb67d4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:30.601175 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-78ac093c-ad49-46e5-b56d-d91381eb67d4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:30.601596 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-78ac093c-ad49-46e5-b56d-d91381eb67d4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:30.736010 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-78ac093c-ad49-46e5-b56d-d91381eb67d4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:30.741168 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:29:30.743921 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-78ac093c-ad49-46e5-b56d-d91381eb67d4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1267 microversion: 2.1 time: 0.155322 Sep 09 23:29:30.745101 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 486/943] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:30 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:31.025127 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1f04106b-3dcd-4a2a-8137-b056a5960f30 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:31.026537 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-1f04106b-3dcd-4a2a-8137-b056a5960f30 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:31.032825 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1f04106b-3dcd-4a2a-8137-b056a5960f30 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:31.033338 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1f04106b-3dcd-4a2a-8137-b056a5960f30 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:31.033790 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1f04106b-3dcd-4a2a-8137-b056a5960f30 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:31.034515 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1f04106b-3dcd-4a2a-8137-b056a5960f30 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:31.034982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1f04106b-3dcd-4a2a-8137-b056a5960f30 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:31.035413 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1f04106b-3dcd-4a2a-8137-b056a5960f30 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:31.167671 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1f04106b-3dcd-4a2a-8137-b056a5960f30 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:31.175511 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-1f04106b-3dcd-4a2a-8137-b056a5960f30 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1573 microversion: 2.1 time: 0.155412 Sep 09 23:29:31.176076 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 458/944] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:31 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:31.767694 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d42021e6-2be9-4ccd-b728-55154e53058f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:31.768293 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d42021e6-2be9-4ccd-b728-55154e53058f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:31.775460 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d42021e6-2be9-4ccd-b728-55154e53058f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:31.776038 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d42021e6-2be9-4ccd-b728-55154e53058f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:31.776623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d42021e6-2be9-4ccd-b728-55154e53058f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:31.777332 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d42021e6-2be9-4ccd-b728-55154e53058f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:31.777799 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d42021e6-2be9-4ccd-b728-55154e53058f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:31.778233 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d42021e6-2be9-4ccd-b728-55154e53058f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:31.911305 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d42021e6-2be9-4ccd-b728-55154e53058f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:31.919297 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d42021e6-2be9-4ccd-b728-55154e53058f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1267 microversion: 2.1 time: 0.155626 Sep 09 23:29:31.919873 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 487/945] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:31 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:32.200557 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e5915f70-e5be-4308-a537-666131d1305b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:32.201300 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e5915f70-e5be-4308-a537-666131d1305b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:32.203393 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:29:32.208019 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e5915f70-e5be-4308-a537-666131d1305b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:32.208508 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e5915f70-e5be-4308-a537-666131d1305b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:32.208950 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e5915f70-e5be-4308-a537-666131d1305b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:32.209639 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e5915f70-e5be-4308-a537-666131d1305b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:32.210097 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e5915f70-e5be-4308-a537-666131d1305b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:32.210561 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e5915f70-e5be-4308-a537-666131d1305b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:32.341502 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e5915f70-e5be-4308-a537-666131d1305b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:32.349192 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e5915f70-e5be-4308-a537-666131d1305b tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1560 microversion: 2.1 time: 0.153915 Sep 09 23:29:32.349776 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 459/946] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:32 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:32.942921 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ddf190aa-6adc-415f-a55a-659c098859ea tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:32.943528 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ddf190aa-6adc-415f-a55a-659c098859ea tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:32.950982 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ddf190aa-6adc-415f-a55a-659c098859ea tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:32.951467 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ddf190aa-6adc-415f-a55a-659c098859ea tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:32.951896 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ddf190aa-6adc-415f-a55a-659c098859ea tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:32.952587 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ddf190aa-6adc-415f-a55a-659c098859ea tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:32.953878 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ddf190aa-6adc-415f-a55a-659c098859ea tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:32.953878 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ddf190aa-6adc-415f-a55a-659c098859ea tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:33.098835 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ddf190aa-6adc-415f-a55a-659c098859ea tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:33.106552 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ddf190aa-6adc-415f-a55a-659c098859ea tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1267 microversion: 2.1 time: 0.167598 Sep 09 23:29:33.107112 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 488/947] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:32 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:34.128743 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-912bcdb0-b4b4-4f6a-a0e8-863a3327210f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:34.129386 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-912bcdb0-b4b4-4f6a-a0e8-863a3327210f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:34.131796 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=2 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:29:34.136135 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=6 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:29:34.137447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-912bcdb0-b4b4-4f6a-a0e8-863a3327210f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:34.137934 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-912bcdb0-b4b4-4f6a-a0e8-863a3327210f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:34.138394 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-912bcdb0-b4b4-4f6a-a0e8-863a3327210f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:34.139084 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-912bcdb0-b4b4-4f6a-a0e8-863a3327210f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:34.139572 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-912bcdb0-b4b4-4f6a-a0e8-863a3327210f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:34.139998 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-912bcdb0-b4b4-4f6a-a0e8-863a3327210f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:34.271962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-912bcdb0-b4b4-4f6a-a0e8-863a3327210f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:34.280159 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-912bcdb0-b4b4-4f6a-a0e8-863a3327210f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1267 microversion: 2.1 time: 0.155500 Sep 09 23:29:34.280724 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 460/948] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:34 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:35.303282 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-920717d8-cece-4325-b488-5da251c63b67 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:35.303930 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-920717d8-cece-4325-b488-5da251c63b67 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:35.305752 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=2 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:29:35.312019 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-920717d8-cece-4325-b488-5da251c63b67 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:35.315215 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-920717d8-cece-4325-b488-5da251c63b67 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:35.315215 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-920717d8-cece-4325-b488-5da251c63b67 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:35.315215 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-920717d8-cece-4325-b488-5da251c63b67 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:35.315215 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-920717d8-cece-4325-b488-5da251c63b67 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:35.315607 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-920717d8-cece-4325-b488-5da251c63b67 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:35.454097 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-920717d8-cece-4325-b488-5da251c63b67 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:35.461748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-920717d8-cece-4325-b488-5da251c63b67 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1267 microversion: 2.1 time: 0.162343 Sep 09 23:29:35.462310 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 489/949] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:35 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:36.486065 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-91636605-d9d9-41fe-954e-510bb51c7bd6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:36.486650 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-91636605-d9d9-41fe-954e-510bb51c7bd6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:36.493251 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-91636605-d9d9-41fe-954e-510bb51c7bd6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:36.493765 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-91636605-d9d9-41fe-954e-510bb51c7bd6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:36.494208 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-91636605-d9d9-41fe-954e-510bb51c7bd6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:36.495444 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-91636605-d9d9-41fe-954e-510bb51c7bd6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:36.495902 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-91636605-d9d9-41fe-954e-510bb51c7bd6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:36.496330 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-91636605-d9d9-41fe-954e-510bb51c7bd6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:36.632068 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-91636605-d9d9-41fe-954e-510bb51c7bd6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:36.640649 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-91636605-d9d9-41fe-954e-510bb51c7bd6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1267 microversion: 2.1 time: 0.158794 Sep 09 23:29:36.641231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 461/950] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:36 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:37.664180 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-459175ad-07fe-4062-bfe3-9491dbaa8bd4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:37.664726 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-459175ad-07fe-4062-bfe3-9491dbaa8bd4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:37.671718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-459175ad-07fe-4062-bfe3-9491dbaa8bd4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:37.672201 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-459175ad-07fe-4062-bfe3-9491dbaa8bd4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:37.672639 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-459175ad-07fe-4062-bfe3-9491dbaa8bd4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:37.673330 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-459175ad-07fe-4062-bfe3-9491dbaa8bd4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:37.673812 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-459175ad-07fe-4062-bfe3-9491dbaa8bd4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:37.674238 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-459175ad-07fe-4062-bfe3-9491dbaa8bd4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:37.806855 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-459175ad-07fe-4062-bfe3-9491dbaa8bd4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:37.814408 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-459175ad-07fe-4062-bfe3-9491dbaa8bd4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1267 microversion: 2.1 time: 0.154197 Sep 09 23:29:37.818175 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 490/951] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:37 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:38.192929 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-e70247e3-89db-4de8-a143-168782e52e5f req-15b3d254-e836-437c-8d6b-51102dee2737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f980e0-fd89-4da8-a658-577721144b73", "name": "network-vif-plugged", "status": "completed", "tag": "ce012a55-46cc-4eaf-94c4-5c066c18f1a2"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:29:38.203756 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-e70247e3-89db-4de8-a143-168782e52e5f req-15b3d254-e836-437c-8d6b-51102dee2737 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:38.206747 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-e70247e3-89db-4de8-a143-168782e52e5f req-15b3d254-e836-437c-8d6b-51102dee2737 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:38.206747 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-e70247e3-89db-4de8-a143-168782e52e5f req-15b3d254-e836-437c-8d6b-51102dee2737 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:38.216249 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-e70247e3-89db-4de8-a143-168782e52e5f req-15b3d254-e836-437c-8d6b-51102dee2737 service nova] Creating event network-vif-plugged:ce012a55-46cc-4eaf-94c4-5c066c18f1a2 for instance 47f980e0-fd89-4da8-a658-577721144b73 on hv-cinder-85032 Sep 09 23:29:38.221219 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-e70247e3-89db-4de8-a143-168782e52e5f req-15b3d254-e836-437c-8d6b-51102dee2737 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031898 Sep 09 23:29:38.221813 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 462/952] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:29:38.837090 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4ea3b8c7-0562-4527-9c10-9d44dc46e669 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:38.837693 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4ea3b8c7-0562-4527-9c10-9d44dc46e669 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:38.844189 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4ea3b8c7-0562-4527-9c10-9d44dc46e669 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:38.844673 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4ea3b8c7-0562-4527-9c10-9d44dc46e669 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:38.845115 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4ea3b8c7-0562-4527-9c10-9d44dc46e669 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:38.845794 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4ea3b8c7-0562-4527-9c10-9d44dc46e669 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:38.846248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4ea3b8c7-0562-4527-9c10-9d44dc46e669 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:38.846695 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4ea3b8c7-0562-4527-9c10-9d44dc46e669 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:38.985261 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4ea3b8c7-0562-4527-9c10-9d44dc46e669 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:38.993225 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4ea3b8c7-0562-4527-9c10-9d44dc46e669 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1267 microversion: 2.1 time: 0.160004 Sep 09 23:29:38.993864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 491/953] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:38 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:40.018332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-97f37e5d-89b1-4eca-9a0c-877f989a3f03 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:40.019084 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-97f37e5d-89b1-4eca-9a0c-877f989a3f03 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:40.025326 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-97f37e5d-89b1-4eca-9a0c-877f989a3f03 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:40.026003 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-97f37e5d-89b1-4eca-9a0c-877f989a3f03 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:40.026579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-97f37e5d-89b1-4eca-9a0c-877f989a3f03 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:40.027284 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-97f37e5d-89b1-4eca-9a0c-877f989a3f03 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:40.027744 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-97f37e5d-89b1-4eca-9a0c-877f989a3f03 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:40.028172 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-97f37e5d-89b1-4eca-9a0c-877f989a3f03 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:40.157685 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-97f37e5d-89b1-4eca-9a0c-877f989a3f03 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:40.165448 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-97f37e5d-89b1-4eca-9a0c-877f989a3f03 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1267 microversion: 2.1 time: 0.152060 Sep 09 23:29:40.166017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 463/954] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:40 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:41.189575 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e66448bb-70b3-4b4c-bcad-850cfbfef9bc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:41.190116 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e66448bb-70b3-4b4c-bcad-850cfbfef9bc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:41.196513 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e66448bb-70b3-4b4c-bcad-850cfbfef9bc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:41.196993 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e66448bb-70b3-4b4c-bcad-850cfbfef9bc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:41.198001 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e66448bb-70b3-4b4c-bcad-850cfbfef9bc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:41.198718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e66448bb-70b3-4b4c-bcad-850cfbfef9bc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:41.199174 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e66448bb-70b3-4b4c-bcad-850cfbfef9bc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:41.199597 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e66448bb-70b3-4b4c-bcad-850cfbfef9bc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:41.329110 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e66448bb-70b3-4b4c-bcad-850cfbfef9bc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:41.336843 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e66448bb-70b3-4b4c-bcad-850cfbfef9bc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1455 microversion: 2.1 time: 0.151217 Sep 09 23:29:41.337408 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 492/955] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:41 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:41.359344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e73bd1fc-f4ab-416f-b19e-50d2bce98cb4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:41.360021 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e73bd1fc-f4ab-416f-b19e-50d2bce98cb4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:41.366706 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e73bd1fc-f4ab-416f-b19e-50d2bce98cb4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:41.367188 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e73bd1fc-f4ab-416f-b19e-50d2bce98cb4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:41.367629 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e73bd1fc-f4ab-416f-b19e-50d2bce98cb4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:41.368320 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e73bd1fc-f4ab-416f-b19e-50d2bce98cb4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:41.368778 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e73bd1fc-f4ab-416f-b19e-50d2bce98cb4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:41.369226 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e73bd1fc-f4ab-416f-b19e-50d2bce98cb4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:41.503457 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e73bd1fc-f4ab-416f-b19e-50d2bce98cb4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:41.512211 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e73bd1fc-f4ab-416f-b19e-50d2bce98cb4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1455 microversion: 2.1 time: 0.156801 Sep 09 23:29:41.512782 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 464/956] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:29:41 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:43.812051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-256c66ff-ba76-4100-a233-c1e57b607494 req-5c15f4bc-586d-480b-bd81-c06eb963fa7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f980e0-fd89-4da8-a658-577721144b73", "tag": "ce012a55-46cc-4eaf-94c4-5c066c18f1a2"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:29:43.822301 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-256c66ff-ba76-4100-a233-c1e57b607494 req-5c15f4bc-586d-480b-bd81-c06eb963fa7f service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:43.823658 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-256c66ff-ba76-4100-a233-c1e57b607494 req-5c15f4bc-586d-480b-bd81-c06eb963fa7f service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:43.823658 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-256c66ff-ba76-4100-a233-c1e57b607494 req-5c15f4bc-586d-480b-bd81-c06eb963fa7f service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:43.834549 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-256c66ff-ba76-4100-a233-c1e57b607494 req-5c15f4bc-586d-480b-bd81-c06eb963fa7f service nova] Creating event network-changed:ce012a55-46cc-4eaf-94c4-5c066c18f1a2 for instance 47f980e0-fd89-4da8-a658-577721144b73 on hv-cinder-85032 Sep 09 23:29:43.840986 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-256c66ff-ba76-4100-a233-c1e57b607494 req-5c15f4bc-586d-480b-bd81-c06eb963fa7f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032553 Sep 09 23:29:43.841680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 493/957] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:29:44.309366 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-495cc6b3-6245-4981-be8c-5b9f231a920b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:44.312509 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-495cc6b3-6245-4981-be8c-5b9f231a920b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:44.319526 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-495cc6b3-6245-4981-be8c-5b9f231a920b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:44.320094 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-495cc6b3-6245-4981-be8c-5b9f231a920b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:44.320821 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-495cc6b3-6245-4981-be8c-5b9f231a920b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:44.321540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-495cc6b3-6245-4981-be8c-5b9f231a920b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:44.322005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-495cc6b3-6245-4981-be8c-5b9f231a920b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:44.323000 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-495cc6b3-6245-4981-be8c-5b9f231a920b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:44.369380 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=100 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:29:44.374050 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-495cc6b3-6245-4981-be8c-5b9f231a920b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.069384 Sep 09 23:29:44.374666 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 465/958] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Sep 9 23:29:44 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:29:44.449552 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f0eaffc6-7865-4f97-bd74-c575e30a0948 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:44.450152 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f0eaffc6-7865-4f97-bd74-c575e30a0948 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:44.456723 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f0eaffc6-7865-4f97-bd74-c575e30a0948 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:44.457218 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f0eaffc6-7865-4f97-bd74-c575e30a0948 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:44.457665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f0eaffc6-7865-4f97-bd74-c575e30a0948 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:44.458647 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f0eaffc6-7865-4f97-bd74-c575e30a0948 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:44.459113 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f0eaffc6-7865-4f97-bd74-c575e30a0948 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:44.459546 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f0eaffc6-7865-4f97-bd74-c575e30a0948 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:44.487908 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f0eaffc6-7865-4f97-bd74-c575e30a0948 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Going to try to terminate instance {{(pid=121059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:29:44.775465 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f0eaffc6-7865-4f97-bd74-c575e30a0948 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 204 len: 0 microversion: 2.20 time: 0.330525 Sep 09 23:29:44.776336 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 494/959] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Sep 9 23:29:44 2022] DELETE /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 23:29:44.784543 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5efb3eb8-5e89-4722-bb3a-d40aeefbfbb3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:44.786483 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5efb3eb8-5e89-4722-bb3a-d40aeefbfbb3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:44.791691 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5efb3eb8-5e89-4722-bb3a-d40aeefbfbb3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:44.792112 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5efb3eb8-5e89-4722-bb3a-d40aeefbfbb3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:44.792546 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5efb3eb8-5e89-4722-bb3a-d40aeefbfbb3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:44.793230 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5efb3eb8-5e89-4722-bb3a-d40aeefbfbb3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:44.793673 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5efb3eb8-5e89-4722-bb3a-d40aeefbfbb3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:44.794094 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5efb3eb8-5e89-4722-bb3a-d40aeefbfbb3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:44.928322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5efb3eb8-5e89-4722-bb3a-d40aeefbfbb3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:44.936542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5efb3eb8-5e89-4722-bb3a-d40aeefbfbb3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:44.937977 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5efb3eb8-5e89-4722-bb3a-d40aeefbfbb3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:44.939194 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5efb3eb8-5e89-4722-bb3a-d40aeefbfbb3 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.158534 Sep 09 23:29:44.944698 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 466/960] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:29:44 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:29:45.966574 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-54b552b9-5431-4afe-934e-d7e3c9aff8cd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:45.967275 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-54b552b9-5431-4afe-934e-d7e3c9aff8cd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:45.973711 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54b552b9-5431-4afe-934e-d7e3c9aff8cd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:45.974196 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54b552b9-5431-4afe-934e-d7e3c9aff8cd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:45.974680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54b552b9-5431-4afe-934e-d7e3c9aff8cd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:45.975368 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54b552b9-5431-4afe-934e-d7e3c9aff8cd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:45.975824 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54b552b9-5431-4afe-934e-d7e3c9aff8cd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:45.976248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54b552b9-5431-4afe-934e-d7e3c9aff8cd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:46.112471 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-54b552b9-5431-4afe-934e-d7e3c9aff8cd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:46.122480 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-54b552b9-5431-4afe-934e-d7e3c9aff8cd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:46.122668 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-54b552b9-5431-4afe-934e-d7e3c9aff8cd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:46.123828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-54b552b9-5431-4afe-934e-d7e3c9aff8cd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1722 microversion: 2.20 time: 0.162076 Sep 09 23:29:46.124397 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 495/961] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:29:45 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:29:47.149171 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-fd18b3fe-2353-41db-b14c-cd8b182dbb23 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:47.155580 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-fd18b3fe-2353-41db-b14c-cd8b182dbb23 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:47.156842 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd18b3fe-2353-41db-b14c-cd8b182dbb23 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:47.157346 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd18b3fe-2353-41db-b14c-cd8b182dbb23 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:47.157963 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd18b3fe-2353-41db-b14c-cd8b182dbb23 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:47.158888 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd18b3fe-2353-41db-b14c-cd8b182dbb23 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:47.159519 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd18b3fe-2353-41db-b14c-cd8b182dbb23 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:47.159956 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-fd18b3fe-2353-41db-b14c-cd8b182dbb23 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:47.208616 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-59670708-8dad-4b55-9eb8-ad96128cf266 req-3a305335-7ad3-4b95-a80b-904684f0319f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a008236c-707a-4578-912c-07adedbb10cb", "name": "network-vif-deleted", "tag": "b8c3dd2c-6785-40c3-87d8-e3d4dae738c5"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:29:47.218682 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-59670708-8dad-4b55-9eb8-ad96128cf266 req-3a305335-7ad3-4b95-a80b-904684f0319f service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:47.219411 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-59670708-8dad-4b55-9eb8-ad96128cf266 req-3a305335-7ad3-4b95-a80b-904684f0319f service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:47.219841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-59670708-8dad-4b55-9eb8-ad96128cf266 req-3a305335-7ad3-4b95-a80b-904684f0319f service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:47.233339 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-59670708-8dad-4b55-9eb8-ad96128cf266 req-3a305335-7ad3-4b95-a80b-904684f0319f service nova] Creating event network-vif-deleted:b8c3dd2c-6785-40c3-87d8-e3d4dae738c5 for instance a008236c-707a-4578-912c-07adedbb10cb on hv-cinder-85032 Sep 09 23:29:47.236073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-fd18b3fe-2353-41db-b14c-cd8b182dbb23 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:47.239028 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-59670708-8dad-4b55-9eb8-ad96128cf266 req-3a305335-7ad3-4b95-a80b-904684f0319f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033678 Sep 09 23:29:47.239274 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 496/962] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:29:47.246151 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-fd18b3fe-2353-41db-b14c-cd8b182dbb23 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:47.247789 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-fd18b3fe-2353-41db-b14c-cd8b182dbb23 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:47.249089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-fd18b3fe-2353-41db-b14c-cd8b182dbb23 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1655 microversion: 2.20 time: 0.103919 Sep 09 23:29:47.252218 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 467/963] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:29:47 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1655 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:29:48.280332 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:48.280933 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:48.287447 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:48.287931 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:48.288370 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:48.289064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:48.289521 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:48.289946 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:48.330566 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:48.331048 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:48.331502 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:48.331928 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lazy-loading 'fault' on Instance uuid a008236c-707a-4578-912c-07adedbb10cb {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:29:48.377991 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:48.387611 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:48.389481 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27be0979440d4ab081dae31790280eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6c3ad574e46fd9d3b37ead0542a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:29:48.390867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-475fa753-0a18-4ac9-adf1-05c7737f053b tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 200 len: 1372 microversion: 2.20 time: 0.115983 Sep 09 23:29:48.391601 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 497/964] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:29:48 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 1372 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 23:29:49.419697 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0a16a425-7133-487f-8a4f-ef1d1c045967 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:49.420322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0a16a425-7133-487f-8a4f-ef1d1c045967 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:49.426826 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a16a425-7133-487f-8a4f-ef1d1c045967 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:49.427311 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a16a425-7133-487f-8a4f-ef1d1c045967 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:49.427750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a16a425-7133-487f-8a4f-ef1d1c045967 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:49.428451 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a16a425-7133-487f-8a4f-ef1d1c045967 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:49.428908 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a16a425-7133-487f-8a4f-ef1d1c045967 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:49.429340 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0a16a425-7133-487f-8a4f-ef1d1c045967 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:49.443398 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-0a16a425-7133-487f-8a4f-ef1d1c045967 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] HTTP exception thrown: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0a16a425-7133-487f-8a4f-ef1d1c045967 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Request method failure captured: Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb HTTP/1.1 Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8q5F4aEPp2xsaUOSTg_jeMQB6rQi2QUkVY7eUq1059hz2EVu45WV59Y73UeLvRk4rYN6DeCLjCPJZO6yv1D2W5oEeMEr_K_f4bBAe9Pa7wNZD-Rm9WAv8CpL78JF3AkWSsj5UgG7QWNBfbEWiyacgNTWAbUDdmXZjbVcAou5GgtPsg Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: fbe6c3ad574e46fd9d3b37ead0542a18 Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:29:49.445054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:29:49.446860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fbe6c3ad574e46fd9d3b37ead0542a18", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:29:49.446860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:29:49.446860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: fbe6c3ad574e46fd9d3b37ead0542a18 Sep 09 23:29:49.446860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:29:49.446860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-AttachVolumeShelveTestJSON-2105690103-project Sep 09 23:29:49.446860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:29:49.446860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:29:49.446860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 27be0979440d4ab081dae31790280eff Sep 09 23:29:49.446860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2105690103-project Sep 09 23:29:49.446860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:29:49.446860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. Sep 09 23:29:49.446860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': 'a008236c-707a-4578-912c-07adedbb10cb'} Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:29:49.448231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. Sep 09 23:29:49.450044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:29:49.451667 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0a16a425-7133-487f-8a4f-ef1d1c045967 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Returning 404 to user: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:29:49.451667 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0a16a425-7133-487f-8a4f-ef1d1c045967 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 404 len: 111 microversion: 2.20 time: 0.033319 Sep 09 23:29:49.451667 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 468/965] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:29:49 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:29:49.456529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d30c613a-790d-4197-9039-54a94deefe75 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '.version_select at 0x7f908dc34a60>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:49.559371 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d30c613a-790d-4197-9039-54a94deefe75 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274619386" status: 204 len: 0 microversion: 2.20 time: 0.106750 Sep 09 23:29:49.559949 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 498/966] 10.222.0.20 () {60 vars in 1262 bytes} [Fri Sep 9 23:29:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274619386 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 23:29:51.557819 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1d27dc09-dfe2-4e67-b55b-89353d61b7ed tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:51.558311 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-1d27dc09-dfe2-4e67-b55b-89353d61b7ed tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:51.564608 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d27dc09-dfe2-4e67-b55b-89353d61b7ed tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:51.565085 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d27dc09-dfe2-4e67-b55b-89353d61b7ed tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:51.565520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d27dc09-dfe2-4e67-b55b-89353d61b7ed tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:51.566207 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d27dc09-dfe2-4e67-b55b-89353d61b7ed tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:51.566678 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d27dc09-dfe2-4e67-b55b-89353d61b7ed tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:51.567103 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1d27dc09-dfe2-4e67-b55b-89353d61b7ed tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:51.581065 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-1d27dc09-dfe2-4e67-b55b-89353d61b7ed tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] HTTP exception thrown: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1d27dc09-dfe2-4e67-b55b-89353d61b7ed tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Request method failure captured: Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: DELETE /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb HTTP/1.1 Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8q5F4aEPp2xsaUOSTg_jeMQB6rQi2QUkVY7eUq1059hz2EVu45WV59Y73UeLvRk4rYN6DeCLjCPJZO6yv1D2W5oEeMEr_K_f4bBAe9Pa7wNZD-Rm9WAv8CpL78JF3AkWSsj5UgG7QWNBfbEWiyacgNTWAbUDdmXZjbVcAou5GgtPsg Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: fbe6c3ad574e46fd9d3b37ead0542a18 Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:29:51.582632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:29:51.584244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fbe6c3ad574e46fd9d3b37ead0542a18", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:29:51.584244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:29:51.584244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: fbe6c3ad574e46fd9d3b37ead0542a18 Sep 09 23:29:51.584244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:29:51.584244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-AttachVolumeShelveTestJSON-2105690103-project Sep 09 23:29:51.584244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:29:51.584244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:29:51.584244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 27be0979440d4ab081dae31790280eff Sep 09 23:29:51.584244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2105690103-project Sep 09 23:29:51.584244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:29:51.584244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. Sep 09 23:29:51.584244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': 'a008236c-707a-4578-912c-07adedbb10cb'} Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:29:51.585187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. Sep 09 23:29:51.586725 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:29:51.588559 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1d27dc09-dfe2-4e67-b55b-89353d61b7ed tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Returning 404 to user: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:29:51.588559 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-1d27dc09-dfe2-4e67-b55b-89353d61b7ed tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 404 len: 111 microversion: 2.20 time: 0.030668 Sep 09 23:29:51.588559 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 469/967] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Sep 9 23:29:51 2022] DELETE /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:29:51.593005 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8c1a6ae5-075d-49b9-a950-17a82b798619 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:51.593651 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8c1a6ae5-075d-49b9-a950-17a82b798619 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: a008236c-707a-4578-912c-07adedbb10cb] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:51.600446 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c1a6ae5-075d-49b9-a950-17a82b798619 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:51.600928 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c1a6ae5-075d-49b9-a950-17a82b798619 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:51.601367 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c1a6ae5-075d-49b9-a950-17a82b798619 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:51.602055 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c1a6ae5-075d-49b9-a950-17a82b798619 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:51.602546 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c1a6ae5-075d-49b9-a950-17a82b798619 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:51.602966 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c1a6ae5-075d-49b9-a950-17a82b798619 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:51.616665 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-8c1a6ae5-075d-49b9-a950-17a82b798619 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] HTTP exception thrown: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8c1a6ae5-075d-49b9-a950-17a82b798619 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Request method failure captured: Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb HTTP/1.1 Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8q5F4aEPp2xsaUOSTg_jeMQB6rQi2QUkVY7eUq1059hz2EVu45WV59Y73UeLvRk4rYN6DeCLjCPJZO6yv1D2W5oEeMEr_K_f4bBAe9Pa7wNZD-Rm9WAv8CpL78JF3AkWSsj5UgG7QWNBfbEWiyacgNTWAbUDdmXZjbVcAou5GgtPsg Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: fbe6c3ad574e46fd9d3b37ead0542a18 Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:29:51.618299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:29:51.621029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fbe6c3ad574e46fd9d3b37ead0542a18", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:29:51.621029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:29:51.621029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: fbe6c3ad574e46fd9d3b37ead0542a18 Sep 09 23:29:51.621029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:29:51.621029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeShelveTestJSON-2105690103-project Sep 09 23:29:51.621029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:29:51.621029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:29:51.621029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 27be0979440d4ab081dae31790280eff Sep 09 23:29:51.621029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2105690103-project Sep 09 23:29:51.621029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:29:51.621029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. Sep 09 23:29:51.621029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': 'a008236c-707a-4578-912c-07adedbb10cb'} Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:29:51.621942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. Sep 09 23:29:51.623432 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:29:51.624677 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8c1a6ae5-075d-49b9-a950-17a82b798619 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Returning 404 to user: Instance a008236c-707a-4578-912c-07adedbb10cb could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:29:51.624677 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8c1a6ae5-075d-49b9-a950-17a82b798619 tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb" status: 404 len: 111 microversion: 2.20 time: 0.031931 Sep 09 23:29:51.624677 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 499/968] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:29:51 2022] GET /compute/v2.1/servers/a008236c-707a-4578-912c-07adedbb10cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:29:52.105666 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-38a10995-a466-4aa9-8211-a61eb7077027 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:52.106174 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-38a10995-a466-4aa9-8211-a61eb7077027 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:52.112365 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-38a10995-a466-4aa9-8211-a61eb7077027 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:52.112883 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-38a10995-a466-4aa9-8211-a61eb7077027 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:52.113356 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-38a10995-a466-4aa9-8211-a61eb7077027 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:52.114044 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-38a10995-a466-4aa9-8211-a61eb7077027 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:52.114560 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-38a10995-a466-4aa9-8211-a61eb7077027 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:52.114993 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-38a10995-a466-4aa9-8211-a61eb7077027 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:52.138392 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-38a10995-a466-4aa9-8211-a61eb7077027 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56/ips" status: 200 len: 150 microversion: 2.1 time: 0.037233 Sep 09 23:29:52.138966 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 470/969] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 23:29:52 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:29:52.873425 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-85a83fba-74bf-46dd-a0d8-ddf2b060054d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:52.873923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-85a83fba-74bf-46dd-a0d8-ddf2b060054d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:52.880425 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85a83fba-74bf-46dd-a0d8-ddf2b060054d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:52.880902 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85a83fba-74bf-46dd-a0d8-ddf2b060054d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:52.881338 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85a83fba-74bf-46dd-a0d8-ddf2b060054d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:52.882025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85a83fba-74bf-46dd-a0d8-ddf2b060054d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:52.882516 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85a83fba-74bf-46dd-a0d8-ddf2b060054d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:52.882942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-85a83fba-74bf-46dd-a0d8-ddf2b060054d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:52.896138 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-85a83fba-74bf-46dd-a0d8-ddf2b060054d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] HTTP exception thrown: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-85a83fba-74bf-46dd-a0d8-ddf2b060054d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Request method failure captured: Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: DELETE /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 HTTP/1.1 Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8q5F4aEPp2xsaUOSTg_jeMQB6rQi2QUkVY7eUq1059hz2EVu45WV59Y73UeLvRk4rYN6DeCLjCPJZO6yv1D2W5oEeMEr_K_f4bBAe9Pa7wNZD-Rm9WAv8CpL78JF3AkWSsj5UgG7QWNBfbEWiyacgNTWAbUDdmXZjbVcAou5GgtPsg Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: fbe6c3ad574e46fd9d3b37ead0542a18 Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:29:52.897681 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:29:52.899343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fbe6c3ad574e46fd9d3b37ead0542a18", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:29:52.899343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:29:52.899343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: fbe6c3ad574e46fd9d3b37ead0542a18 Sep 09 23:29:52.899343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:29:52.899343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeShelveTestJSON-2105690103-project Sep 09 23:29:52.899343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:29:52.899343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:29:52.899343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 27be0979440d4ab081dae31790280eff Sep 09 23:29:52.899343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2105690103-project Sep 09 23:29:52.899343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:29:52.899343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. Sep 09 23:29:52.899343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '61a8b2e1-79be-4c0d-b316-94c95ae04638'} Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:29:52.900864 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. Sep 09 23:29:52.902407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:29:52.903971 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-85a83fba-74bf-46dd-a0d8-ddf2b060054d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Returning 404 to user: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:29:52.903971 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-85a83fba-74bf-46dd-a0d8-ddf2b060054d tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 404 len: 111 microversion: 2.20 time: 0.029688 Sep 09 23:29:52.903971 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 500/970] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Sep 9 23:29:52 2022] DELETE /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:29:52.916542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-abf67d68-480e-4a67-a803-717cfab461fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:29:52.916542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-abf67d68-480e-4a67-a803-717cfab461fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] [instance: 61a8b2e1-79be-4c0d-b316-94c95ae04638] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:52.920986 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-abf67d68-480e-4a67-a803-717cfab461fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:52.921465 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-abf67d68-480e-4a67-a803-717cfab461fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:52.921903 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-abf67d68-480e-4a67-a803-717cfab461fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:52.922623 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-abf67d68-480e-4a67-a803-717cfab461fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:52.923080 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-abf67d68-480e-4a67-a803-717cfab461fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:52.923509 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-abf67d68-480e-4a67-a803-717cfab461fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:52.937289 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-abf67d68-480e-4a67-a803-717cfab461fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] HTTP exception thrown: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-abf67d68-480e-4a67-a803-717cfab461fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Request method failure captured: Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 HTTP/1.1 Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8q5F4aEPp2xsaUOSTg_jeMQB6rQi2QUkVY7eUq1059hz2EVu45WV59Y73UeLvRk4rYN6DeCLjCPJZO6yv1D2W5oEeMEr_K_f4bBAe9Pa7wNZD-Rm9WAv8CpL78JF3AkWSsj5UgG7QWNBfbEWiyacgNTWAbUDdmXZjbVcAou5GgtPsg Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: fbe6c3ad574e46fd9d3b37ead0542a18 Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:29:52.941540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:29:52.943327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbe6c3ad574e46fd9d3b37ead0542a18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fbe6c3ad574e46fd9d3b37ead0542a18", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:29:52.943327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:29:52.943327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: fbe6c3ad574e46fd9d3b37ead0542a18 Sep 09 23:29:52.943327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2105690103 Sep 09 23:29:52.943327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-AttachVolumeShelveTestJSON-2105690103-project Sep 09 23:29:52.943327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:29:52.943327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:29:52.943327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 27be0979440d4ab081dae31790280eff Sep 09 23:29:52.943327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2105690103-project Sep 09 23:29:52.943327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:29:52.943327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. Sep 09 23:29:52.943327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '61a8b2e1-79be-4c0d-b316-94c95ae04638'} Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:29:52.944262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. Sep 09 23:29:52.945754 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:29:52.947646 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-abf67d68-480e-4a67-a803-717cfab461fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] Returning 404 to user: Instance 61a8b2e1-79be-4c0d-b316-94c95ae04638 could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:29:52.947646 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-abf67d68-480e-4a67-a803-717cfab461fd tempest-AttachVolumeShelveTestJSON-2105690103 tempest-AttachVolumeShelveTestJSON-2105690103-project] 10.222.0.20 "GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638" status: 404 len: 111 microversion: 2.20 time: 0.031308 Sep 09 23:29:52.947646 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 471/971] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 23:29:52 2022] GET /compute/v2.1/servers/61a8b2e1-79be-4c0d-b316-94c95ae04638 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:29:53.877280 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b9fb3c3c-4210-41e7-ab50-b8553136957e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1368ad4-5171-4234-bcae-9bf9134fa841"}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:29:53.879680 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b9fb3c3c-4210-41e7-ab50-b8553136957e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:29:53.886827 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b9fb3c3c-4210-41e7-ab50-b8553136957e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:53.887313 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b9fb3c3c-4210-41e7-ab50-b8553136957e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:53.887766 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b9fb3c3c-4210-41e7-ab50-b8553136957e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:53.888500 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b9fb3c3c-4210-41e7-ab50-b8553136957e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:29:53.888952 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b9fb3c3c-4210-41e7-ab50-b8553136957e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:29:53.889402 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b9fb3c3c-4210-41e7-ab50-b8553136957e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:29:54.625795 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b9fb3c3c-4210-41e7-ab50-b8553136957e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "POST /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752373 Sep 09 23:29:54.630299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 501/972] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 23:29:53 2022] POST /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:30:02.183498 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-eddc7a4b-04b9-4f19-828a-7db97dbeaaa9 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Action: 'create', calling method: .version_select at 0x7f908dd7f550>, body: {"keypair": {"name": "tempest-keypair-296098506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfz9YXkfUzRaRtUY8mV9gul+B5CdijsTjEtjvKFWH5lOoi1bI4B6HvhijB4B5TlRUA6M5frwyuteVx6iLXjNnPZ8x8l855cAybmy4VwGOGpN+O3B2IVXDORhissum/fXA=="}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:30:02.199439 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-eddc7a4b-04b9-4f19-828a-7db97dbeaaa9 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'key_pairs'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:30:02.203155 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-eddc7a4b-04b9-4f19-828a-7db97dbeaaa9 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for user 592da799f0c540d68a2cc6d54006467c and project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'key_pairs'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:30:02.325362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-eddc7a4b-04b9-4f19-828a-7db97dbeaaa9 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146154 Sep 09 23:30:02.326036 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 472/973] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 23:30:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:30:04.595088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:30:04.595874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:30:04.600504 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1088426485", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a5627a6-2ca5-4346-988f-094c3aa681f1"}], "security_groups": [{"name": "tempest-securitygroup--705887910"}], "key_name": "tempest-keypair-296098506", "user_data": "}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:30:04.707126 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.network.neutron [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] validate_networks() for [('9a5627a6-2ca5-4346-988f-094c3aa681f1', None, None, None, None, None)] {{(pid=121059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:30:05.080250 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Flavor limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:30:05.080674 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Image limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:30:05.081156 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Flavor pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:30:05.081561 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Image pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:30:05.081972 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:30:05.092019 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:05.092501 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:05.092942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:05.093668 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:05.094129 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:05.094587 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:05.112410 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:30:05.116351 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for user 592da799f0c540d68a2cc6d54006467c and project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:30:05.127349 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Going to run 1 instances... {{(pid=121059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:30:05.129775 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:30:05.282887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-167750e9-d72a-40a3-9174-077c45c60b5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.689434 Sep 09 23:30:05.283536 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 502/974] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:30:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:30:05.291525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=23 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:30:05.296687 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4cedf3ff-9d14-49e4-bfa6-f84bfa865e4e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:05.297304 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4cedf3ff-9d14-49e4-bfa6-f84bfa865e4e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:05.299093 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:30:05.352848 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4cedf3ff-9d14-49e4-bfa6-f84bfa865e4e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:30:05.360536 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4cedf3ff-9d14-49e4-bfa6-f84bfa865e4e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 200 len: 1241 microversion: 2.1 time: 0.069741 Sep 09 23:30:05.361362 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 473/975] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:30:05 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:30:06.384951 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-939551f2-9d23-456f-9200-a876b5bf3b69 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:06.385562 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-939551f2-9d23-456f-9200-a876b5bf3b69 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:06.392828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-939551f2-9d23-456f-9200-a876b5bf3b69 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:06.393367 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-939551f2-9d23-456f-9200-a876b5bf3b69 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:06.393805 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-939551f2-9d23-456f-9200-a876b5bf3b69 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:06.394522 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-939551f2-9d23-456f-9200-a876b5bf3b69 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:06.394977 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-939551f2-9d23-456f-9200-a876b5bf3b69 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:06.395402 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-939551f2-9d23-456f-9200-a876b5bf3b69 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:06.460338 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-939551f2-9d23-456f-9200-a876b5bf3b69 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:30:06.468260 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-939551f2-9d23-456f-9200-a876b5bf3b69 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 200 len: 1245 microversion: 2.1 time: 0.087971 Sep 09 23:30:06.468831 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 503/976] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:30:06 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:30:07.493459 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5c6d4f9e-6b53-42bb-8578-dc0ba53f7b99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:07.494079 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5c6d4f9e-6b53-42bb-8578-dc0ba53f7b99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:07.501063 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5c6d4f9e-6b53-42bb-8578-dc0ba53f7b99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:07.501547 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5c6d4f9e-6b53-42bb-8578-dc0ba53f7b99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:07.501987 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5c6d4f9e-6b53-42bb-8578-dc0ba53f7b99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:07.502728 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5c6d4f9e-6b53-42bb-8578-dc0ba53f7b99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:07.503187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5c6d4f9e-6b53-42bb-8578-dc0ba53f7b99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:07.503697 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5c6d4f9e-6b53-42bb-8578-dc0ba53f7b99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:07.572678 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5c6d4f9e-6b53-42bb-8578-dc0ba53f7b99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:30:07.581838 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5c6d4f9e-6b53-42bb-8578-dc0ba53f7b99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 200 len: 1301 microversion: 2.1 time: 0.091842 Sep 09 23:30:07.584450 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 474/977] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:30:07 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 1301 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:30:08.614733 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b47617d6-50ab-49e1-8e70-0579291b47df tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:08.614733 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b47617d6-50ab-49e1-8e70-0579291b47df tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:08.620922 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b47617d6-50ab-49e1-8e70-0579291b47df tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:08.621562 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b47617d6-50ab-49e1-8e70-0579291b47df tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:08.622994 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b47617d6-50ab-49e1-8e70-0579291b47df tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:08.623713 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b47617d6-50ab-49e1-8e70-0579291b47df tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:08.624294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b47617d6-50ab-49e1-8e70-0579291b47df tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:08.624796 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b47617d6-50ab-49e1-8e70-0579291b47df tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:08.828617 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b47617d6-50ab-49e1-8e70-0579291b47df tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:30:08.836593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b47617d6-50ab-49e1-8e70-0579291b47df tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 200 len: 1366 microversion: 2.1 time: 0.232414 Sep 09 23:30:08.837251 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 504/978] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:30:08 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:30:09.327437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-74ef41a5-4e4a-4548-934f-bfe3c836c006 req-ba17b423-7649-47cd-ab23-08d01b50b2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af84898-4d31-4109-ab87-199f3b65c034", "tag": "eb97ff97-c8a2-41bd-8dd6-f18e0c7f8fd8"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:30:09.338378 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-74ef41a5-4e4a-4548-934f-bfe3c836c006 req-ba17b423-7649-47cd-ab23-08d01b50b2e1 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:09.338860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-74ef41a5-4e4a-4548-934f-bfe3c836c006 req-ba17b423-7649-47cd-ab23-08d01b50b2e1 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:09.340210 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-74ef41a5-4e4a-4548-934f-bfe3c836c006 req-ba17b423-7649-47cd-ab23-08d01b50b2e1 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:09.351616 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-74ef41a5-4e4a-4548-934f-bfe3c836c006 req-ba17b423-7649-47cd-ab23-08d01b50b2e1 service nova] Creating event network-changed:eb97ff97-c8a2-41bd-8dd6-f18e0c7f8fd8 for instance 0af84898-4d31-4109-ab87-199f3b65c034 on hv-cinder-85032 Sep 09 23:30:09.356646 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-74ef41a5-4e4a-4548-934f-bfe3c836c006 req-ba17b423-7649-47cd-ab23-08d01b50b2e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033675 Sep 09 23:30:09.357243 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 475/979] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:30:09.860625 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a50e0ee1-78d3-4ca5-b6d5-c5a14f4f60a6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:09.861654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a50e0ee1-78d3-4ca5-b6d5-c5a14f4f60a6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:09.868700 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a50e0ee1-78d3-4ca5-b6d5-c5a14f4f60a6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:09.869209 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a50e0ee1-78d3-4ca5-b6d5-c5a14f4f60a6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:09.869741 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a50e0ee1-78d3-4ca5-b6d5-c5a14f4f60a6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:09.870647 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a50e0ee1-78d3-4ca5-b6d5-c5a14f4f60a6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:09.871202 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a50e0ee1-78d3-4ca5-b6d5-c5a14f4f60a6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:09.871739 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a50e0ee1-78d3-4ca5-b6d5-c5a14f4f60a6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:10.079519 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a50e0ee1-78d3-4ca5-b6d5-c5a14f4f60a6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:30:10.087409 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a50e0ee1-78d3-4ca5-b6d5-c5a14f4f60a6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 200 len: 1366 microversion: 2.1 time: 0.230784 Sep 09 23:30:10.088168 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 505/980] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:30:09 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:30:11.116636 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0c163528-1c86-4888-9f40-6c9eb82ad782 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:11.117951 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0c163528-1c86-4888-9f40-6c9eb82ad782 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:11.127294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c163528-1c86-4888-9f40-6c9eb82ad782 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:11.127801 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c163528-1c86-4888-9f40-6c9eb82ad782 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:11.128244 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c163528-1c86-4888-9f40-6c9eb82ad782 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:11.128948 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c163528-1c86-4888-9f40-6c9eb82ad782 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:11.129408 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c163528-1c86-4888-9f40-6c9eb82ad782 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:11.129838 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0c163528-1c86-4888-9f40-6c9eb82ad782 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:11.264402 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0c163528-1c86-4888-9f40-6c9eb82ad782 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:30:11.271973 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0c163528-1c86-4888-9f40-6c9eb82ad782 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 200 len: 1366 microversion: 2.1 time: 0.165112 Sep 09 23:30:11.272534 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 476/981] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:30:11 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:30:12.294660 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-54ff865d-cc94-4387-9e10-44c8c6f2e2b6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:12.297306 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-54ff865d-cc94-4387-9e10-44c8c6f2e2b6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:12.301579 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54ff865d-cc94-4387-9e10-44c8c6f2e2b6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:12.302093 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54ff865d-cc94-4387-9e10-44c8c6f2e2b6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:12.302570 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54ff865d-cc94-4387-9e10-44c8c6f2e2b6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:12.303261 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54ff865d-cc94-4387-9e10-44c8c6f2e2b6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:12.303712 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54ff865d-cc94-4387-9e10-44c8c6f2e2b6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:12.304134 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54ff865d-cc94-4387-9e10-44c8c6f2e2b6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:12.441354 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-54ff865d-cc94-4387-9e10-44c8c6f2e2b6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:30:12.449382 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-54ff865d-cc94-4387-9e10-44c8c6f2e2b6 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 200 len: 1366 microversion: 2.1 time: 0.158657 Sep 09 23:30:12.449949 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 506/982] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:30:12 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:30:13.473153 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-071484e7-9a8c-403c-a562-5c71ea720a08 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:13.473810 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-071484e7-9a8c-403c-a562-5c71ea720a08 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:13.480316 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-071484e7-9a8c-403c-a562-5c71ea720a08 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:13.480802 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-071484e7-9a8c-403c-a562-5c71ea720a08 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:13.481240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-071484e7-9a8c-403c-a562-5c71ea720a08 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:13.482280 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-071484e7-9a8c-403c-a562-5c71ea720a08 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:13.482813 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-071484e7-9a8c-403c-a562-5c71ea720a08 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:13.483204 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-071484e7-9a8c-403c-a562-5c71ea720a08 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:13.616950 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-071484e7-9a8c-403c-a562-5c71ea720a08 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:30:13.625540 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-071484e7-9a8c-403c-a562-5c71ea720a08 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 200 len: 1366 microversion: 2.1 time: 0.156503 Sep 09 23:30:13.626106 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 477/983] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:30:13 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:30:14.344238 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-96e94c9f-efad-4417-b8b4-ed97eb9dfdfe req-ac9c5f4c-c957-46a1-bcd8-c1b6ab81908f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af84898-4d31-4109-ab87-199f3b65c034", "name": "network-vif-plugged", "status": "completed", "tag": "eb97ff97-c8a2-41bd-8dd6-f18e0c7f8fd8"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:30:14.354273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-96e94c9f-efad-4417-b8b4-ed97eb9dfdfe req-ac9c5f4c-c957-46a1-bcd8-c1b6ab81908f service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:14.354798 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-96e94c9f-efad-4417-b8b4-ed97eb9dfdfe req-ac9c5f4c-c957-46a1-bcd8-c1b6ab81908f service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:14.355236 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-96e94c9f-efad-4417-b8b4-ed97eb9dfdfe req-ac9c5f4c-c957-46a1-bcd8-c1b6ab81908f service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:14.369372 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-96e94c9f-efad-4417-b8b4-ed97eb9dfdfe req-ac9c5f4c-c957-46a1-bcd8-c1b6ab81908f service nova] Creating event network-vif-plugged:eb97ff97-c8a2-41bd-8dd6-f18e0c7f8fd8 for instance 0af84898-4d31-4109-ab87-199f3b65c034 on hv-cinder-85032 Sep 09 23:30:14.374498 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-96e94c9f-efad-4417-b8b4-ed97eb9dfdfe req-ac9c5f4c-c957-46a1-bcd8-c1b6ab81908f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034685 Sep 09 23:30:14.375097 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 507/984] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:30:14.654229 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9ad3da50-3035-4c35-b5a8-1ff6e80878f4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:14.659337 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9ad3da50-3035-4c35-b5a8-1ff6e80878f4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:14.663375 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ad3da50-3035-4c35-b5a8-1ff6e80878f4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:14.663871 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ad3da50-3035-4c35-b5a8-1ff6e80878f4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:14.664306 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ad3da50-3035-4c35-b5a8-1ff6e80878f4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:14.665010 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ad3da50-3035-4c35-b5a8-1ff6e80878f4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:14.665470 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ad3da50-3035-4c35-b5a8-1ff6e80878f4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:14.665914 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ad3da50-3035-4c35-b5a8-1ff6e80878f4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:14.801210 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9ad3da50-3035-4c35-b5a8-1ff6e80878f4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:30:14.808805 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9ad3da50-3035-4c35-b5a8-1ff6e80878f4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 200 len: 1366 microversion: 2.1 time: 0.158392 Sep 09 23:30:14.809367 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 478/985] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:30:14 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:30:15.830149 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=2 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:30:15.830953 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=6 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:30:15.835411 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a18f2f3b-2387-4b3a-b326-f957c0b4a38a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:15.836106 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a18f2f3b-2387-4b3a-b326-f957c0b4a38a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:15.842204 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a18f2f3b-2387-4b3a-b326-f957c0b4a38a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:15.843877 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a18f2f3b-2387-4b3a-b326-f957c0b4a38a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:15.843877 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a18f2f3b-2387-4b3a-b326-f957c0b4a38a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:15.844104 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a18f2f3b-2387-4b3a-b326-f957c0b4a38a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:15.844529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a18f2f3b-2387-4b3a-b326-f957c0b4a38a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:15.844960 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a18f2f3b-2387-4b3a-b326-f957c0b4a38a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:15.973657 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a18f2f3b-2387-4b3a-b326-f957c0b4a38a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:30:15.981685 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a18f2f3b-2387-4b3a-b326-f957c0b4a38a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 200 len: 1366 microversion: 2.1 time: 0.152233 Sep 09 23:30:15.982249 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 508/986] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:30:15 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:30:17.004542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-31986252-d3bb-4392-a478-6e4ae7f7aa2c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:17.005159 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-31986252-d3bb-4392-a478-6e4ae7f7aa2c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:17.007159 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=6 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:30:17.012386 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-31986252-d3bb-4392-a478-6e4ae7f7aa2c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:17.012866 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-31986252-d3bb-4392-a478-6e4ae7f7aa2c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:17.013310 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-31986252-d3bb-4392-a478-6e4ae7f7aa2c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:17.014002 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-31986252-d3bb-4392-a478-6e4ae7f7aa2c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:17.014495 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-31986252-d3bb-4392-a478-6e4ae7f7aa2c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:17.014923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-31986252-d3bb-4392-a478-6e4ae7f7aa2c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:17.144009 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-31986252-d3bb-4392-a478-6e4ae7f7aa2c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:30:17.151852 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-31986252-d3bb-4392-a478-6e4ae7f7aa2c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 200 len: 1556 microversion: 2.1 time: 0.151615 Sep 09 23:30:17.152424 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 479/987] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:30:16 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:30:17.175401 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e176cbfd-3d50-47c0-92f6-d826abf7e0d2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:17.175930 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e176cbfd-3d50-47c0-92f6-d826abf7e0d2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:17.182207 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e176cbfd-3d50-47c0-92f6-d826abf7e0d2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:17.182723 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e176cbfd-3d50-47c0-92f6-d826abf7e0d2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:17.183154 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e176cbfd-3d50-47c0-92f6-d826abf7e0d2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:17.183839 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e176cbfd-3d50-47c0-92f6-d826abf7e0d2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:17.184290 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e176cbfd-3d50-47c0-92f6-d826abf7e0d2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:17.184711 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e176cbfd-3d50-47c0-92f6-d826abf7e0d2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:17.283974 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e176cbfd-3d50-47c0-92f6-d826abf7e0d2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111891 Sep 09 23:30:17.285448 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 509/988] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 23:30:17 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:30:18.566608 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-e75d2145-3a55-44ac-8d9a-3e6057790475 req-409441a5-8b78-48b9-acd0-d6df2d693965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af84898-4d31-4109-ab87-199f3b65c034", "tag": "eb97ff97-c8a2-41bd-8dd6-f18e0c7f8fd8"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:30:18.576546 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-e75d2145-3a55-44ac-8d9a-3e6057790475 req-409441a5-8b78-48b9-acd0-d6df2d693965 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:18.577024 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-e75d2145-3a55-44ac-8d9a-3e6057790475 req-409441a5-8b78-48b9-acd0-d6df2d693965 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:18.577453 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-e75d2145-3a55-44ac-8d9a-3e6057790475 req-409441a5-8b78-48b9-acd0-d6df2d693965 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:18.589046 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-e75d2145-3a55-44ac-8d9a-3e6057790475 req-409441a5-8b78-48b9-acd0-d6df2d693965 service nova] Creating event network-changed:eb97ff97-c8a2-41bd-8dd6-f18e0c7f8fd8 for instance 0af84898-4d31-4109-ab87-199f3b65c034 on hv-cinder-85032 Sep 09 23:30:18.594067 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-e75d2145-3a55-44ac-8d9a-3e6057790475 req-409441a5-8b78-48b9-acd0-d6df2d693965 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031973 Sep 09 23:30:18.595147 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 480/989] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:30:54.832680 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=17 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:30:54.834149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=34 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:30:54.838958 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:30:54.839808 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-bf066aab-8899-4243-abba-28a96309d7e4 req-a0924cef-df94-446f-83ee-a663c4daecee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d367ef-58a3-46c5-94d6-8723e6cca32b", "tag": "c92b2495-b9d4-4026-960c-2b98f517147e"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:30:54.842049 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=38 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:30:54.850027 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-bf066aab-8899-4243-abba-28a96309d7e4 req-a0924cef-df94-446f-83ee-a663c4daecee service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:54.850555 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-bf066aab-8899-4243-abba-28a96309d7e4 req-a0924cef-df94-446f-83ee-a663c4daecee service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:54.851020 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-bf066aab-8899-4243-abba-28a96309d7e4 req-a0924cef-df94-446f-83ee-a663c4daecee service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:54.856164 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8c5c69ed-8e95-44af-ab73-7952c2dabfac tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:54.857186 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8c5c69ed-8e95-44af-ab73-7952c2dabfac tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:54.863641 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-bf066aab-8899-4243-abba-28a96309d7e4 req-a0924cef-df94-446f-83ee-a663c4daecee service nova] Creating event network-changed:c92b2495-b9d4-4026-960c-2b98f517147e for instance 77d367ef-58a3-46c5-94d6-8723e6cca32b on hv-cinder-85032 Sep 09 23:30:54.871159 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c5c69ed-8e95-44af-ab73-7952c2dabfac tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:54.871655 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c5c69ed-8e95-44af-ab73-7952c2dabfac tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:54.872278 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c5c69ed-8e95-44af-ab73-7952c2dabfac tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:54.873163 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c5c69ed-8e95-44af-ab73-7952c2dabfac tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:54.873318 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-bf066aab-8899-4243-abba-28a96309d7e4 req-a0924cef-df94-446f-83ee-a663c4daecee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040943 Sep 09 23:30:54.873925 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c5c69ed-8e95-44af-ab73-7952c2dabfac tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:54.874378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8c5c69ed-8e95-44af-ab73-7952c2dabfac tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:54.879734 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 481/990] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:30:54.907034 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8c5c69ed-8e95-44af-ab73-7952c2dabfac tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Going to try to terminate instance {{(pid=121059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:30:55.311774 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8c5c69ed-8e95-44af-ab73-7952c2dabfac tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 204 len: 0 microversion: 2.1 time: 0.481411 Sep 09 23:30:55.312369 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 510/991] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:30:54 2022] DELETE /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:30:55.323494 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ec68bdda-2d45-4adc-a7e0-f07bb14e635a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:55.324193 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ec68bdda-2d45-4adc-a7e0-f07bb14e635a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:55.332300 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec68bdda-2d45-4adc-a7e0-f07bb14e635a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:55.333010 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec68bdda-2d45-4adc-a7e0-f07bb14e635a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:55.333603 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec68bdda-2d45-4adc-a7e0-f07bb14e635a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:55.334504 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec68bdda-2d45-4adc-a7e0-f07bb14e635a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:55.335117 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec68bdda-2d45-4adc-a7e0-f07bb14e635a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:55.335778 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ec68bdda-2d45-4adc-a7e0-f07bb14e635a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:55.530076 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ec68bdda-2d45-4adc-a7e0-f07bb14e635a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:30:55.542463 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ec68bdda-2d45-4adc-a7e0-f07bb14e635a tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1566 microversion: 2.1 time: 0.225565 Sep 09 23:30:55.543149 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 482/992] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:30:55 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1566 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:30:56.567289 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fb278a9c-0f94-49dd-bfe2-a4c3d4182e2e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:56.568029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-fb278a9c-0f94-49dd-bfe2-a4c3d4182e2e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:56.575113 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb278a9c-0f94-49dd-bfe2-a4c3d4182e2e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:56.575616 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb278a9c-0f94-49dd-bfe2-a4c3d4182e2e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:56.576055 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb278a9c-0f94-49dd-bfe2-a4c3d4182e2e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:56.576760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb278a9c-0f94-49dd-bfe2-a4c3d4182e2e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:56.577217 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb278a9c-0f94-49dd-bfe2-a4c3d4182e2e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:56.577771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fb278a9c-0f94-49dd-bfe2-a4c3d4182e2e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:56.788813 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fb278a9c-0f94-49dd-bfe2-a4c3d4182e2e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:30:56.796816 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-fb278a9c-0f94-49dd-bfe2-a4c3d4182e2e tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1566 microversion: 2.1 time: 0.234065 Sep 09 23:30:56.797379 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 511/993] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:30:56 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1566 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:30:57.575504 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-6d5fe0ab-338a-4092-8e3a-6c30f411c398 req-6b7a026c-7428-4408-92e7-951f61810506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d367ef-58a3-46c5-94d6-8723e6cca32b", "name": "network-vif-deleted", "tag": "c92b2495-b9d4-4026-960c-2b98f517147e"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:30:57.586111 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-6d5fe0ab-338a-4092-8e3a-6c30f411c398 req-6b7a026c-7428-4408-92e7-951f61810506 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:57.586623 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-6d5fe0ab-338a-4092-8e3a-6c30f411c398 req-6b7a026c-7428-4408-92e7-951f61810506 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:57.587061 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-6d5fe0ab-338a-4092-8e3a-6c30f411c398 req-6b7a026c-7428-4408-92e7-951f61810506 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:57.598818 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-6d5fe0ab-338a-4092-8e3a-6c30f411c398 req-6b7a026c-7428-4408-92e7-951f61810506 service nova] Creating event network-vif-deleted:c92b2495-b9d4-4026-960c-2b98f517147e for instance 77d367ef-58a3-46c5-94d6-8723e6cca32b on hv-cinder-85032 Sep 09 23:30:57.603877 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-6d5fe0ab-338a-4092-8e3a-6c30f411c398 req-6b7a026c-7428-4408-92e7-951f61810506 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031998 Sep 09 23:30:57.604481 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 483/994] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:30:57.821421 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-93ab0e07-aa0d-41aa-8c8b-bcd1e6c57083 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:57.822207 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-93ab0e07-aa0d-41aa-8c8b-bcd1e6c57083 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:57.828621 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-93ab0e07-aa0d-41aa-8c8b-bcd1e6c57083 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:57.832615 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-93ab0e07-aa0d-41aa-8c8b-bcd1e6c57083 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:57.832615 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-93ab0e07-aa0d-41aa-8c8b-bcd1e6c57083 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:57.832615 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-93ab0e07-aa0d-41aa-8c8b-bcd1e6c57083 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:57.832615 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-93ab0e07-aa0d-41aa-8c8b-bcd1e6c57083 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:57.833319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-93ab0e07-aa0d-41aa-8c8b-bcd1e6c57083 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:57.895656 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-93ab0e07-aa0d-41aa-8c8b-bcd1e6c57083 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:30:57.906436 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-93ab0e07-aa0d-41aa-8c8b-bcd1e6c57083 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1219 microversion: 2.1 time: 0.089377 Sep 09 23:30:57.907343 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 512/995] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:30:57 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:30:58.930314 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-46ec36ba-ee22-46a7-82f3-0ba20dca03d6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:30:58.931035 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-46ec36ba-ee22-46a7-82f3-0ba20dca03d6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:30:58.937662 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-46ec36ba-ee22-46a7-82f3-0ba20dca03d6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:58.938371 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-46ec36ba-ee22-46a7-82f3-0ba20dca03d6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:58.938802 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-46ec36ba-ee22-46a7-82f3-0ba20dca03d6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:58.939508 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-46ec36ba-ee22-46a7-82f3-0ba20dca03d6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:58.940065 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-46ec36ba-ee22-46a7-82f3-0ba20dca03d6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:58.940374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-46ec36ba-ee22-46a7-82f3-0ba20dca03d6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:58.973755 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-46ec36ba-ee22-46a7-82f3-0ba20dca03d6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:30:58.974266 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-46ec36ba-ee22-46a7-82f3-0ba20dca03d6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:30:58.974762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-46ec36ba-ee22-46a7-82f3-0ba20dca03d6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:30:58.975214 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-46ec36ba-ee22-46a7-82f3-0ba20dca03d6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lazy-loading 'fault' on Instance uuid 77d367ef-58a3-46c5-94d6-8723e6cca32b {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:30:59.019882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-46ec36ba-ee22-46a7-82f3-0ba20dca03d6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9d4a796a8c450486832bb10c3d4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602875e689b7476697ce2e9bbc3bf7b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:30:59.028291 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-46ec36ba-ee22-46a7-82f3-0ba20dca03d6 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 200 len: 1224 microversion: 2.1 time: 0.102968 Sep 09 23:30:59.028871 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 484/996] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:30:58 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:00.051527 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-543d0a14-5ae1-46a7-80aa-61cb7f1453c7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:00.052148 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-543d0a14-5ae1-46a7-80aa-61cb7f1453c7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] [instance: 77d367ef-58a3-46c5-94d6-8723e6cca32b] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:00.060605 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-543d0a14-5ae1-46a7-80aa-61cb7f1453c7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:00.061090 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-543d0a14-5ae1-46a7-80aa-61cb7f1453c7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:00.061520 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-543d0a14-5ae1-46a7-80aa-61cb7f1453c7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:00.062240 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-543d0a14-5ae1-46a7-80aa-61cb7f1453c7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:00.062719 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-543d0a14-5ae1-46a7-80aa-61cb7f1453c7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:00.063143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-543d0a14-5ae1-46a7-80aa-61cb7f1453c7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:00.076469 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-543d0a14-5ae1-46a7-80aa-61cb7f1453c7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] HTTP exception thrown: Instance 77d367ef-58a3-46c5-94d6-8723e6cca32b could not be found. Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-543d0a14-5ae1-46a7-80aa-61cb7f1453c7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Request method failure captured: Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b HTTP/1.1 Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8uJn0d86dYiCJ-lW5LGl5zupwvR1n4CU3Mm2KX6MVU-yGUHu-syrKnvEv7-UsiRUOzxwvgpQ5MO4709X_xHbx_N1VlfiZ3key_urSwKGlLJET_RTtrcDcsdf6zB4tUV-t3F9LhpLQ8aN3gDeGF1y3eV1G83jVu4XgDx2Qs6qKtIIz0 Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 602875e689b7476697ce2e9bbc3bf7b5 Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-TestShelveInstance-680402463 Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:31:00.078120 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:31:00.079999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/602875e689b7476697ce2e9bbc3bf7b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/602875e689b7476697ce2e9bbc3bf7b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/602875e689b7476697ce2e9bbc3bf7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_602875e689b7476697ce2e9bbc3bf7b5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:31:00.079999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-TestShelveInstance-680402463 Sep 09 23:31:00.079999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 602875e689b7476697ce2e9bbc3bf7b5 Sep 09 23:31:00.079999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-TestShelveInstance-680402463 Sep 09 23:31:00.079999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-TestShelveInstance-680402463-project Sep 09 23:31:00.079999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:31:00.079999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:31:00.079999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: cf9d4a796a8c450486832bb10c3d4ad0 Sep 09 23:31:00.079999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-TestShelveInstance-680402463-project Sep 09 23:31:00.079999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:31:00.079999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 77d367ef-58a3-46c5-94d6-8723e6cca32b could not be found. Sep 09 23:31:00.079999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '77d367ef-58a3-46c5-94d6-8723e6cca32b'} Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d367ef-58a3-46c5-94d6-8723e6cca32b could not be found. Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:31:00.081004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d367ef-58a3-46c5-94d6-8723e6cca32b could not be found. Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d367ef-58a3-46c5-94d6-8723e6cca32b could not be found. Sep 09 23:31:00.082380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:31:00.083772 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-543d0a14-5ae1-46a7-80aa-61cb7f1453c7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Returning 404 to user: Instance 77d367ef-58a3-46c5-94d6-8723e6cca32b could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:31:00.083772 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-543d0a14-5ae1-46a7-80aa-61cb7f1453c7 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b" status: 404 len: 111 microversion: 2.1 time: 0.032028 Sep 09 23:31:00.083772 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 513/997] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:00 2022] GET /compute/v2.1/servers/77d367ef-58a3-46c5-94d6-8723e6cca32b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:31:00.356341 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-eaf1c18f-d011-4b63-8054-6d8cbc744ac1 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] Calling method '.version_select at 0x7f908de8da60>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:00.457874 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-eaf1c18f-d011-4b63-8054-6d8cbc744ac1 tempest-TestShelveInstance-680402463 tempest-TestShelveInstance-680402463-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-469023736" status: 202 len: 0 microversion: 2.1 time: 0.105308 Sep 09 23:31:00.458505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 485/998] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 23:31:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-469023736 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:31:01.995595 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3e59ff81-d509-42e4-8c4f-355177581493 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:01.996187 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3e59ff81-d509-42e4-8c4f-355177581493 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:02.002538 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e59ff81-d509-42e4-8c4f-355177581493 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:02.003030 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e59ff81-d509-42e4-8c4f-355177581493 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:02.003913 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e59ff81-d509-42e4-8c4f-355177581493 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:02.004235 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e59ff81-d509-42e4-8c4f-355177581493 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:02.004701 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e59ff81-d509-42e4-8c4f-355177581493 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:02.005146 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3e59ff81-d509-42e4-8c4f-355177581493 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:02.031035 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3e59ff81-d509-42e4-8c4f-355177581493 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034/ips" status: 200 len: 149 microversion: 2.1 time: 0.039966 Sep 09 23:31:02.031584 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 514/999] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 23:31:01 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:31:02.045077 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-edd848ed-69e6-4c94-a05c-1fff93fb652a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1368ad4-5171-4234-bcae-9bf9134fa841"}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:31:02.047545 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-edd848ed-69e6-4c94-a05c-1fff93fb652a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:02.055326 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-edd848ed-69e6-4c94-a05c-1fff93fb652a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:02.055884 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-edd848ed-69e6-4c94-a05c-1fff93fb652a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:02.056345 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-edd848ed-69e6-4c94-a05c-1fff93fb652a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:02.057040 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-edd848ed-69e6-4c94-a05c-1fff93fb652a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:02.057500 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-edd848ed-69e6-4c94-a05c-1fff93fb652a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:02.057932 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-edd848ed-69e6-4c94-a05c-1fff93fb652a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:02.143131 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-edd848ed-69e6-4c94-a05c-1fff93fb652a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] HTTP exception thrown: Invalid volume: volume e1368ad4-5171-4234-bcae-9bf9134fa841 is already attached to instances: 7f29a621-0596-49bf-b3bf-99b52cb9aa56 Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-edd848ed-69e6-4c94-a05c-1fff93fb652a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Request method failure captured: Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: POST /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034/os-volume_attachments HTTP/1.1 Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 74 Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8woRMVyoU9aLaBHLfxWq3rhgSNfpDXsHrJ0JUVxxXk7N_vHMOu7IKDmy7Ln-hyMIN_NjduqULel4lJLROHRtQ-6Op9IQi2psaTOuqyihyzV19hZ7jrQEMS9G45jhSxfqzPTvA4Ts62X0j3XSTOZ7Ne8N5xbdyc_SaHiCOAAIt150ZA Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:31:02.144969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:31:02.146753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d57c38134f1484d9b208de1b9d8e26e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:31:02.146753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:31:02.146753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:31:02.146753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:31:02.146753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:31:02.146753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:31:02.146753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:31:02.146753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 592da799f0c540d68a2cc6d54006467c Sep 09 23:31:02.146753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:31:02.146753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Sep 09 23:31:02.146753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {"volumeAttachment": {"volumeId": "e1368ad4-5171-4234-bcae-9bf9134fa841"}} Sep 09 23:31:02.146753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Invalid volume: volume e1368ad4-5171-4234-bcae-9bf9134fa841 is already attached to instances: 7f29a621-0596-49bf-b3bf-99b52cb9aa56 Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'server_id': '0af84898-4d31-4109-ab87-199f3b65c034', 'body': {'volumeAttachment': {'volumeId': 'e1368ad4-5171-4234-bcae-9bf9134fa841'}}} Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e1368ad4-5171-4234-bcae-9bf9134fa841 is already attached to instances: 7f29a621-0596-49bf-b3bf-99b52cb9aa56 Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:31:02.147867 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e1368ad4-5171-4234-bcae-9bf9134fa841 is already attached to instances: 7f29a621-0596-49bf-b3bf-99b52cb9aa56 Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:31:02.149475 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:31:02.154213 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:31:02.154213 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:31:02.154213 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:31:02.154213 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e1368ad4-5171-4234-bcae-9bf9134fa841 is already attached to instances: 7f29a621-0596-49bf-b3bf-99b52cb9aa56 Sep 09 23:31:02.154213 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:31:02.154213 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-edd848ed-69e6-4c94-a05c-1fff93fb652a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Returning 400 to user: Invalid volume: volume e1368ad4-5171-4234-bcae-9bf9134fa841 is already attached to instances: 7f29a621-0596-49bf-b3bf-99b52cb9aa56 {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:31:02.154213 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-edd848ed-69e6-4c94-a05c-1fff93fb652a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "POST /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107348 Sep 09 23:31:02.154213 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 486/1000] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 23:31:02 2022] POST /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 23:31:02.161899 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f8750713-a2b0-4d49-b661-159ce24a2a56 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:02.162435 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f8750713-a2b0-4d49-b661-159ce24a2a56 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:02.169252 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8750713-a2b0-4d49-b661-159ce24a2a56 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:02.169752 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8750713-a2b0-4d49-b661-159ce24a2a56 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:02.170194 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8750713-a2b0-4d49-b661-159ce24a2a56 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:02.171107 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8750713-a2b0-4d49-b661-159ce24a2a56 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:02.171739 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8750713-a2b0-4d49-b661-159ce24a2a56 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:02.172166 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f8750713-a2b0-4d49-b661-159ce24a2a56 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:02.199546 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f8750713-a2b0-4d49-b661-159ce24a2a56 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Going to try to terminate instance {{(pid=121059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:31:02.486083 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f8750713-a2b0-4d49-b661-159ce24a2a56 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 204 len: 0 microversion: 2.1 time: 0.328857 Sep 09 23:31:02.487455 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 515/1001] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:31:02 2022] DELETE /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:31:02.497453 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ca8c50a0-d6e8-47f1-9b04-5340169de755 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:02.497882 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ca8c50a0-d6e8-47f1-9b04-5340169de755 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:02.504524 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ca8c50a0-d6e8-47f1-9b04-5340169de755 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:02.505243 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ca8c50a0-d6e8-47f1-9b04-5340169de755 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:02.507584 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ca8c50a0-d6e8-47f1-9b04-5340169de755 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:02.508079 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ca8c50a0-d6e8-47f1-9b04-5340169de755 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:02.508931 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ca8c50a0-d6e8-47f1-9b04-5340169de755 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:02.509892 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ca8c50a0-d6e8-47f1-9b04-5340169de755 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:02.956399 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ca8c50a0-d6e8-47f1-9b04-5340169de755 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:02.968775 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ca8c50a0-d6e8-47f1-9b04-5340169de755 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 200 len: 1680 microversion: 2.1 time: 0.471651 Sep 09 23:31:02.968775 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 487/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:02 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 1680 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:03.990896 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d977976b-fa9d-4f90-8460-47bd216d4cb7 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:03.993558 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d977976b-fa9d-4f90-8460-47bd216d4cb7 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:04.000666 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d977976b-fa9d-4f90-8460-47bd216d4cb7 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:04.001433 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d977976b-fa9d-4f90-8460-47bd216d4cb7 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:04.002119 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d977976b-fa9d-4f90-8460-47bd216d4cb7 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:04.003320 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d977976b-fa9d-4f90-8460-47bd216d4cb7 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:04.005376 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d977976b-fa9d-4f90-8460-47bd216d4cb7 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:04.006059 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d977976b-fa9d-4f90-8460-47bd216d4cb7 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:04.343621 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d977976b-fa9d-4f90-8460-47bd216d4cb7 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:04.358558 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d977976b-fa9d-4f90-8460-47bd216d4cb7 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 200 len: 1680 microversion: 2.1 time: 0.370038 Sep 09 23:31:04.359297 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 516/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:03 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 1680 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:05.384886 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9ddd5164-8a12-4b33-b470-633668b6a2a3 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:05.386175 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9ddd5164-8a12-4b33-b470-633668b6a2a3 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:05.397022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ddd5164-8a12-4b33-b470-633668b6a2a3 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:05.397983 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ddd5164-8a12-4b33-b470-633668b6a2a3 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:05.399117 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ddd5164-8a12-4b33-b470-633668b6a2a3 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:05.399998 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ddd5164-8a12-4b33-b470-633668b6a2a3 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:05.400876 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ddd5164-8a12-4b33-b470-633668b6a2a3 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:05.401721 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ddd5164-8a12-4b33-b470-633668b6a2a3 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:05.502837 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9ddd5164-8a12-4b33-b470-633668b6a2a3 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:05.518672 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9ddd5164-8a12-4b33-b470-633668b6a2a3 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 200 len: 1613 microversion: 2.1 time: 0.138343 Sep 09 23:31:05.520659 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 488/1004] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:05 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 1613 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:05.623903 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-e5ecbe0c-5b63-49ed-acdf-c2fbb333fc86 req-66d11330-38e7-4add-b1a9-88704071d539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af84898-4d31-4109-ab87-199f3b65c034", "name": "network-vif-deleted", "tag": "eb97ff97-c8a2-41bd-8dd6-f18e0c7f8fd8"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:31:05.644059 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-e5ecbe0c-5b63-49ed-acdf-c2fbb333fc86 req-66d11330-38e7-4add-b1a9-88704071d539 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:05.644544 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-e5ecbe0c-5b63-49ed-acdf-c2fbb333fc86 req-66d11330-38e7-4add-b1a9-88704071d539 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:05.644978 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-e5ecbe0c-5b63-49ed-acdf-c2fbb333fc86 req-66d11330-38e7-4add-b1a9-88704071d539 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:05.665743 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-e5ecbe0c-5b63-49ed-acdf-c2fbb333fc86 req-66d11330-38e7-4add-b1a9-88704071d539 service nova] Creating event network-vif-deleted:eb97ff97-c8a2-41bd-8dd6-f18e0c7f8fd8 for instance 0af84898-4d31-4109-ab87-199f3b65c034 on hv-cinder-85032 Sep 09 23:31:05.676097 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-e5ecbe0c-5b63-49ed-acdf-c2fbb333fc86 req-66d11330-38e7-4add-b1a9-88704071d539 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055741 Sep 09 23:31:05.680385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 517/1005] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:31:06.550668 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-91dbdc36-813a-4748-94b5-5b9bcecb4287 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:06.550668 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-91dbdc36-813a-4748-94b5-5b9bcecb4287 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:06.556174 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-91dbdc36-813a-4748-94b5-5b9bcecb4287 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:06.556672 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-91dbdc36-813a-4748-94b5-5b9bcecb4287 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:06.557115 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-91dbdc36-813a-4748-94b5-5b9bcecb4287 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:06.557864 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-91dbdc36-813a-4748-94b5-5b9bcecb4287 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:06.558323 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-91dbdc36-813a-4748-94b5-5b9bcecb4287 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:06.558782 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-91dbdc36-813a-4748-94b5-5b9bcecb4287 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:06.600400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-91dbdc36-813a-4748-94b5-5b9bcecb4287 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:06.601183 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-91dbdc36-813a-4748-94b5-5b9bcecb4287 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:06.601660 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-91dbdc36-813a-4748-94b5-5b9bcecb4287 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:06.602115 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-91dbdc36-813a-4748-94b5-5b9bcecb4287 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lazy-loading 'fault' on Instance uuid 0af84898-4d31-4109-ab87-199f3b65c034 {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:31:06.666266 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-91dbdc36-813a-4748-94b5-5b9bcecb4287 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:06.696673 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-91dbdc36-813a-4748-94b5-5b9bcecb4287 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 200 len: 1331 microversion: 2.1 time: 0.156103 Sep 09 23:31:06.698483 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 489/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:06 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 1331 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:07.723313 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-711f5ce0-5b2c-4e08-86d9-b26b45bc6834 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:07.724132 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-711f5ce0-5b2c-4e08-86d9-b26b45bc6834 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:07.730943 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-711f5ce0-5b2c-4e08-86d9-b26b45bc6834 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:07.731429 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-711f5ce0-5b2c-4e08-86d9-b26b45bc6834 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:07.731866 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-711f5ce0-5b2c-4e08-86d9-b26b45bc6834 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:07.732560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-711f5ce0-5b2c-4e08-86d9-b26b45bc6834 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:07.733015 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-711f5ce0-5b2c-4e08-86d9-b26b45bc6834 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:07.733440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-711f5ce0-5b2c-4e08-86d9-b26b45bc6834 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:07.748319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-711f5ce0-5b2c-4e08-86d9-b26b45bc6834 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] HTTP exception thrown: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-711f5ce0-5b2c-4e08-86d9-b26b45bc6834 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Request method failure captured: Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 HTTP/1.1 Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8woRMVyoU9aLaBHLfxWq3rhgSNfpDXsHrJ0JUVxxXk7N_vHMOu7IKDmy7Ln-hyMIN_NjduqULel4lJLROHRtQ-6Op9IQi2psaTOuqyihyzV19hZ7jrQEMS9G45jhSxfqzPTvA4Ts62X0j3XSTOZ7Ne8N5xbdyc_SaHiCOAAIt150ZA Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:31:07.749900 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:31:07.751523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d57c38134f1484d9b208de1b9d8e26e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:31:07.751523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:31:07.751523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:31:07.751523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:31:07.751523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:31:07.751523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:31:07.751523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:31:07.751523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 592da799f0c540d68a2cc6d54006467c Sep 09 23:31:07.751523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:31:07.751523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:31:07.751523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. Sep 09 23:31:07.751523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '0af84898-4d31-4109-ab87-199f3b65c034'} Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:31:07.752451 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. Sep 09 23:31:07.753689 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:31:07.754869 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-711f5ce0-5b2c-4e08-86d9-b26b45bc6834 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Returning 404 to user: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:31:07.754869 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-711f5ce0-5b2c-4e08-86d9-b26b45bc6834 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 404 len: 111 microversion: 2.1 time: 0.032882 Sep 09 23:31:07.754869 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 518/1007] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:07 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:31:07.760694 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4ee3a6b0-071f-411b-9ae0-8c337cf183fb tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '.version_select at 0x7f908de7f820>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:07.872859 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4ee3a6b0-071f-411b-9ae0-8c337cf183fb tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-296098506" status: 202 len: 0 microversion: 2.1 time: 0.116028 Sep 09 23:31:07.873492 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 490/1008] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Sep 9 23:31:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-296098506 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:31:09.078999 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3d4143d8-6cfc-422e-bb45-59eccf748f99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:09.080137 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3d4143d8-6cfc-422e-bb45-59eccf748f99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:09.088560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3d4143d8-6cfc-422e-bb45-59eccf748f99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:09.089872 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3d4143d8-6cfc-422e-bb45-59eccf748f99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:09.090542 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3d4143d8-6cfc-422e-bb45-59eccf748f99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:09.091737 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3d4143d8-6cfc-422e-bb45-59eccf748f99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:09.092367 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3d4143d8-6cfc-422e-bb45-59eccf748f99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:09.092950 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3d4143d8-6cfc-422e-bb45-59eccf748f99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:09.516404 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-3d4143d8-6cfc-422e-bb45-59eccf748f99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lazy-loading 'services' on Instance uuid 7f29a621-0596-49bf-b3bf-99b52cb9aa56 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:31:09.787492 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3d4143d8-6cfc-422e-bb45-59eccf748f99 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56/os-volume_attachments/e1368ad4-5171-4234-bcae-9bf9134fa841" status: 202 len: 0 microversion: 2.1 time: 0.712890 Sep 09 23:31:09.789483 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 519/1009] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 23:31:09 2022] DELETE /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56/os-volume_attachments/e1368ad4-5171-4234-bcae-9bf9134fa841 => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:31:09.797920 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5eb7a44d-f3dc-4ece-bc26-585779f17d20 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:09.800064 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5eb7a44d-f3dc-4ece-bc26-585779f17d20 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:09.808928 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5eb7a44d-f3dc-4ece-bc26-585779f17d20 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:09.809697 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5eb7a44d-f3dc-4ece-bc26-585779f17d20 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:09.810142 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5eb7a44d-f3dc-4ece-bc26-585779f17d20 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:09.810885 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5eb7a44d-f3dc-4ece-bc26-585779f17d20 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:09.811539 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5eb7a44d-f3dc-4ece-bc26-585779f17d20 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:09.811977 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5eb7a44d-f3dc-4ece-bc26-585779f17d20 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:09.843157 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5eb7a44d-f3dc-4ece-bc26-585779f17d20 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049213 Sep 09 23:31:09.843733 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 491/1010] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:31:09 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:31:10.860073 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-98a6c44d-96bd-4876-ba58-114c3139989b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:10.865570 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-98a6c44d-96bd-4876-ba58-114c3139989b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:10.874442 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-98a6c44d-96bd-4876-ba58-114c3139989b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:10.875071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-98a6c44d-96bd-4876-ba58-114c3139989b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:10.875850 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-98a6c44d-96bd-4876-ba58-114c3139989b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:10.876814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-98a6c44d-96bd-4876-ba58-114c3139989b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:10.877482 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-98a6c44d-96bd-4876-ba58-114c3139989b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:10.878109 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-98a6c44d-96bd-4876-ba58-114c3139989b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:10.921437 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-98a6c44d-96bd-4876-ba58-114c3139989b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068269 Sep 09 23:31:10.922018 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 520/1011] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:31:10 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:31:11.008852 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7b40aec9-b06c-4906-beac-10ae5eb0bef5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:11.009510 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7b40aec9-b06c-4906-beac-10ae5eb0bef5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:11.016740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7b40aec9-b06c-4906-beac-10ae5eb0bef5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:11.017341 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7b40aec9-b06c-4906-beac-10ae5eb0bef5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:11.017799 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7b40aec9-b06c-4906-beac-10ae5eb0bef5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:11.018550 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7b40aec9-b06c-4906-beac-10ae5eb0bef5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:11.019107 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7b40aec9-b06c-4906-beac-10ae5eb0bef5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:11.019681 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7b40aec9-b06c-4906-beac-10ae5eb0bef5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:11.047018 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7b40aec9-b06c-4906-beac-10ae5eb0bef5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Going to try to terminate instance {{(pid=121058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:31:11.400824 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7b40aec9-b06c-4906-beac-10ae5eb0bef5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 204 len: 0 microversion: 2.1 time: 0.395746 Sep 09 23:31:11.401937 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 492/1012] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:31:11 2022] DELETE /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:31:11.411837 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-eb8045bb-08aa-482d-83d3-71a09b85df74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:11.412606 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-eb8045bb-08aa-482d-83d3-71a09b85df74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:11.420029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb8045bb-08aa-482d-83d3-71a09b85df74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:11.420580 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb8045bb-08aa-482d-83d3-71a09b85df74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:11.421025 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb8045bb-08aa-482d-83d3-71a09b85df74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:11.421729 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb8045bb-08aa-482d-83d3-71a09b85df74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:11.422184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb8045bb-08aa-482d-83d3-71a09b85df74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:11.422778 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-eb8045bb-08aa-482d-83d3-71a09b85df74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:11.574456 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-eb8045bb-08aa-482d-83d3-71a09b85df74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:11.583690 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-eb8045bb-08aa-482d-83d3-71a09b85df74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1682 microversion: 2.1 time: 0.177377 Sep 09 23:31:11.584856 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 521/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:11 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:31:12.607639 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7d8d3c7a-ca95-4983-8024-1ac424c982ce tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:12.608341 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7d8d3c7a-ca95-4983-8024-1ac424c982ce tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:12.614908 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d8d3c7a-ca95-4983-8024-1ac424c982ce tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:12.615386 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d8d3c7a-ca95-4983-8024-1ac424c982ce tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:12.615819 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d8d3c7a-ca95-4983-8024-1ac424c982ce tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:12.616997 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d8d3c7a-ca95-4983-8024-1ac424c982ce tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:12.617644 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d8d3c7a-ca95-4983-8024-1ac424c982ce tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:12.618062 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7d8d3c7a-ca95-4983-8024-1ac424c982ce tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:12.760313 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-7d8d3c7a-ca95-4983-8024-1ac424c982ce tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:12.768227 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7d8d3c7a-ca95-4983-8024-1ac424c982ce tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1682 microversion: 2.1 time: 0.164707 Sep 09 23:31:12.768789 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 493/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:12 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:13.792870 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ee60151b-6e03-4d12-88d7-ffad964bfe74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:13.793527 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ee60151b-6e03-4d12-88d7-ffad964bfe74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:13.800279 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ee60151b-6e03-4d12-88d7-ffad964bfe74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:13.800771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ee60151b-6e03-4d12-88d7-ffad964bfe74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:13.801222 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ee60151b-6e03-4d12-88d7-ffad964bfe74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:13.801923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ee60151b-6e03-4d12-88d7-ffad964bfe74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:13.802485 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ee60151b-6e03-4d12-88d7-ffad964bfe74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:13.802921 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ee60151b-6e03-4d12-88d7-ffad964bfe74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:13.904023 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ee60151b-6e03-4d12-88d7-ffad964bfe74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:13.912764 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ee60151b-6e03-4d12-88d7-ffad964bfe74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1614 microversion: 2.1 time: 0.124690 Sep 09 23:31:13.914363 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 522/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:13 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1614 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:14.139257 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-c5cbd175-f257-4fd9-8dc3-584585f0d1ac req-71b4789d-f9ab-40d9-9a29-d1f65d659df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f29a621-0596-49bf-b3bf-99b52cb9aa56", "name": "network-vif-deleted", "tag": "bb4482c5-bc5a-4a4b-b35f-25cf0947bbf3"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:31:14.156336 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c5cbd175-f257-4fd9-8dc3-584585f0d1ac req-71b4789d-f9ab-40d9-9a29-d1f65d659df4 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:14.156823 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c5cbd175-f257-4fd9-8dc3-584585f0d1ac req-71b4789d-f9ab-40d9-9a29-d1f65d659df4 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:14.157243 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-c5cbd175-f257-4fd9-8dc3-584585f0d1ac req-71b4789d-f9ab-40d9-9a29-d1f65d659df4 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:14.169207 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-c5cbd175-f257-4fd9-8dc3-584585f0d1ac req-71b4789d-f9ab-40d9-9a29-d1f65d659df4 service nova] Creating event network-vif-deleted:bb4482c5-bc5a-4a4b-b35f-25cf0947bbf3 for instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 on hv-cinder-85032 Sep 09 23:31:14.175051 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-c5cbd175-f257-4fd9-8dc3-584585f0d1ac req-71b4789d-f9ab-40d9-9a29-d1f65d659df4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039663 Sep 09 23:31:14.175655 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 494/1016] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:31:14.937122 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-059aa702-910a-4b63-b30b-749eb6e18550 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:14.937788 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-059aa702-910a-4b63-b30b-749eb6e18550 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:14.945522 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-059aa702-910a-4b63-b30b-749eb6e18550 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:14.951225 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-059aa702-910a-4b63-b30b-749eb6e18550 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:14.951225 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-059aa702-910a-4b63-b30b-749eb6e18550 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:14.951225 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-059aa702-910a-4b63-b30b-749eb6e18550 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:14.951225 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-059aa702-910a-4b63-b30b-749eb6e18550 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:14.952149 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-059aa702-910a-4b63-b30b-749eb6e18550 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:14.984287 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-059aa702-910a-4b63-b30b-749eb6e18550 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:14.984784 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-059aa702-910a-4b63-b30b-749eb6e18550 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:14.985265 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-059aa702-910a-4b63-b30b-749eb6e18550 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:14.985660 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-059aa702-910a-4b63-b30b-749eb6e18550 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lazy-loading 'fault' on Instance uuid 7f29a621-0596-49bf-b3bf-99b52cb9aa56 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:31:15.044110 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-059aa702-910a-4b63-b30b-749eb6e18550 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:15.052460 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-059aa702-910a-4b63-b30b-749eb6e18550 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 200 len: 1331 microversion: 2.1 time: 0.119239 Sep 09 23:31:15.053206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 523/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:14 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:16.079306 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-71986b2d-c68f-4cb1-9a74-e83e657d361c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:16.080010 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-71986b2d-c68f-4cb1-9a74-e83e657d361c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:16.086658 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71986b2d-c68f-4cb1-9a74-e83e657d361c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:16.087137 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71986b2d-c68f-4cb1-9a74-e83e657d361c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:16.087567 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71986b2d-c68f-4cb1-9a74-e83e657d361c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:16.088253 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71986b2d-c68f-4cb1-9a74-e83e657d361c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:16.088703 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71986b2d-c68f-4cb1-9a74-e83e657d361c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:16.089130 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71986b2d-c68f-4cb1-9a74-e83e657d361c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:16.102699 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-71986b2d-c68f-4cb1-9a74-e83e657d361c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] HTTP exception thrown: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-71986b2d-c68f-4cb1-9a74-e83e657d361c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Request method failure captured: Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 HTTP/1.1 Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8woRMVyoU9aLaBHLfxWq3rhgSNfpDXsHrJ0JUVxxXk7N_vHMOu7IKDmy7Ln-hyMIN_NjduqULel4lJLROHRtQ-6Op9IQi2psaTOuqyihyzV19hZ7jrQEMS9G45jhSxfqzPTvA4Ts62X0j3XSTOZ7Ne8N5xbdyc_SaHiCOAAIt150ZA Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:31:16.104344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:31:16.105975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d57c38134f1484d9b208de1b9d8e26e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:31:16.105975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:31:16.105975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:31:16.105975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:31:16.105975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:31:16.105975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:31:16.105975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:31:16.105975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 592da799f0c540d68a2cc6d54006467c Sep 09 23:31:16.105975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:31:16.105975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:31:16.105975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. Sep 09 23:31:16.105975 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '7f29a621-0596-49bf-b3bf-99b52cb9aa56'} Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:31:16.110088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. Sep 09 23:31:16.111575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:31:16.113184 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-71986b2d-c68f-4cb1-9a74-e83e657d361c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Returning 404 to user: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:31:16.113184 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-71986b2d-c68f-4cb1-9a74-e83e657d361c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 404 len: 111 microversion: 2.1 time: 0.031210 Sep 09 23:31:16.113184 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 495/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:16 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:31:16.115984 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-260456ba-cbd9-4b46-936e-862f3127e6eb tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '.version_select at 0x7f908dbdfe50>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:16.227225 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-260456ba-cbd9-4b46-936e-862f3127e6eb tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-409061248" status: 202 len: 0 microversion: 2.1 time: 0.116419 Sep 09 23:31:16.227732 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 524/1019] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Sep 9 23:31:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-409061248 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:31:17.015072 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9df09ac1-a1cc-4628-8bc8-9a49df3e11d7 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Action: 'create', calling method: .version_select at 0x7f908de5e040>, body: {"keypair": {"name": "tempest-keypair-1446413714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWPZiNPoZl1cHBmSA8Xx90fih2wiKIHfj+piEl5bL9JGWkwm1iZ8tX2qDQAQipc0/n+si2Pm6OialcLxXl0Sbxe+KRSaeQMO/72RSquh7SUIHws3fsruvEs+XaSug37dQ=="}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:31:17.033141 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-9df09ac1-a1cc-4628-8bc8-9a49df3e11d7 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'key_pairs'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:31:17.036936 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-9df09ac1-a1cc-4628-8bc8-9a49df3e11d7 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for user 592da799f0c540d68a2cc6d54006467c and project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'key_pairs'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:31:17.149311 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9df09ac1-a1cc-4628-8bc8-9a49df3e11d7 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138273 Sep 09 23:31:17.149991 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 496/1020] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 23:31:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:31:19.494183 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-666143650", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a5627a6-2ca5-4346-988f-094c3aa681f1"}], "security_groups": [{"name": "tempest-securitygroup--1854490618"}], "key_name": "tempest-keypair-1446413714", "user_data": "}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:31:19.603638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.network.neutron [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] validate_networks() for [('9a5627a6-2ca5-4346-988f-094c3aa681f1', None, None, None, None, None)] {{(pid=121059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:31:19.976389 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Flavor limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:31:19.977642 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Image limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:31:19.978121 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Flavor pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:31:19.978635 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Image pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:31:19.979049 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:31:19.988157 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:19.988635 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:19.989070 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:19.989810 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:19.990262 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:19.990716 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:20.011652 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:31:20.016124 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for user 592da799f0c540d68a2cc6d54006467c and project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:31:20.028123 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Going to run 1 instances... {{(pid=121059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:31:20.030664 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:31:20.186062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-6ee9026a-6e4f-4fb6-a467-1a48946650ee tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.697762 Sep 09 23:31:20.186738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 525/1021] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:31:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 23:31:20.199179 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ea4e5b77-5e79-4c2c-b9eb-5b32ea5f4009 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:20.199983 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ea4e5b77-5e79-4c2c-b9eb-5b32ea5f4009 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:20.423342 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ea4e5b77-5e79-4c2c-b9eb-5b32ea5f4009 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:20.431012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ea4e5b77-5e79-4c2c-b9eb-5b32ea5f4009 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 200 len: 1241 microversion: 2.1 time: 0.236963 Sep 09 23:31:20.431570 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 497/1022] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:20 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 1241 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:21.456623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d35a4a28-dfe8-4317-bb40-9732f9d8036f tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:21.457271 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d35a4a28-dfe8-4317-bb40-9732f9d8036f tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:21.463870 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d35a4a28-dfe8-4317-bb40-9732f9d8036f tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:21.464376 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d35a4a28-dfe8-4317-bb40-9732f9d8036f tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:21.464810 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d35a4a28-dfe8-4317-bb40-9732f9d8036f tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:21.465715 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d35a4a28-dfe8-4317-bb40-9732f9d8036f tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:21.466178 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d35a4a28-dfe8-4317-bb40-9732f9d8036f tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:21.466636 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d35a4a28-dfe8-4317-bb40-9732f9d8036f tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:21.470942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:31:21.545594 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d35a4a28-dfe8-4317-bb40-9732f9d8036f tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:21.552017 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d35a4a28-dfe8-4317-bb40-9732f9d8036f tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 200 len: 1237 microversion: 2.1 time: 0.100901 Sep 09 23:31:21.552576 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 526/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:21 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:22.579807 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-adad48ab-2a9f-4eb0-bd48-d950f6a6322d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:22.580672 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-adad48ab-2a9f-4eb0-bd48-d950f6a6322d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:22.587532 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-adad48ab-2a9f-4eb0-bd48-d950f6a6322d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:22.588241 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-adad48ab-2a9f-4eb0-bd48-d950f6a6322d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:22.588748 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-adad48ab-2a9f-4eb0-bd48-d950f6a6322d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:22.589686 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-adad48ab-2a9f-4eb0-bd48-d950f6a6322d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:22.590270 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-adad48ab-2a9f-4eb0-bd48-d950f6a6322d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:22.590803 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-adad48ab-2a9f-4eb0-bd48-d950f6a6322d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:22.677340 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-adad48ab-2a9f-4eb0-bd48-d950f6a6322d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:22.685379 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-adad48ab-2a9f-4eb0-bd48-d950f6a6322d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 200 len: 1311 microversion: 2.1 time: 0.109666 Sep 09 23:31:22.686057 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 498/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:22 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:23.709186 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-891bb44f-7db1-4728-b6a0-d8c5cd3f403a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:23.709815 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-891bb44f-7db1-4728-b6a0-d8c5cd3f403a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:23.717735 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-891bb44f-7db1-4728-b6a0-d8c5cd3f403a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:23.718216 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-891bb44f-7db1-4728-b6a0-d8c5cd3f403a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:23.718682 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-891bb44f-7db1-4728-b6a0-d8c5cd3f403a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:23.719371 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-891bb44f-7db1-4728-b6a0-d8c5cd3f403a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:23.719828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-891bb44f-7db1-4728-b6a0-d8c5cd3f403a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:23.720255 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-891bb44f-7db1-4728-b6a0-d8c5cd3f403a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:23.872304 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-891bb44f-7db1-4728-b6a0-d8c5cd3f403a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:23.880214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-891bb44f-7db1-4728-b6a0-d8c5cd3f403a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 200 len: 1367 microversion: 2.1 time: 0.174937 Sep 09 23:31:23.880861 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 527/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:23 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:31:24.114185 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-179844d7-5f5b-4fff-a2df-16ce1912aa20 req-8711af26-c6a4-41c3-a266-5e89d3ffde5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07912acd-a498-4b7e-80ce-606d8970f528", "tag": "867923d7-36c4-4fc7-abe9-56b6959094a8"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:31:24.130458 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-179844d7-5f5b-4fff-a2df-16ce1912aa20 req-8711af26-c6a4-41c3-a266-5e89d3ffde5c service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:24.131231 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-179844d7-5f5b-4fff-a2df-16ce1912aa20 req-8711af26-c6a4-41c3-a266-5e89d3ffde5c service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:24.131667 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-179844d7-5f5b-4fff-a2df-16ce1912aa20 req-8711af26-c6a4-41c3-a266-5e89d3ffde5c service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:24.147265 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-179844d7-5f5b-4fff-a2df-16ce1912aa20 req-8711af26-c6a4-41c3-a266-5e89d3ffde5c service nova] Creating event network-changed:867923d7-36c4-4fc7-abe9-56b6959094a8 for instance 07912acd-a498-4b7e-80ce-606d8970f528 on hv-cinder-85032 Sep 09 23:31:24.152764 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-179844d7-5f5b-4fff-a2df-16ce1912aa20 req-8711af26-c6a4-41c3-a266-5e89d3ffde5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042798 Sep 09 23:31:24.153688 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 499/1026] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:31:24.905841 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-007705cb-5258-468b-96a8-3ba8a5aeecfe tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:24.906565 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-007705cb-5258-468b-96a8-3ba8a5aeecfe tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:24.913706 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-007705cb-5258-468b-96a8-3ba8a5aeecfe tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:24.914203 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-007705cb-5258-468b-96a8-3ba8a5aeecfe tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:24.914738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-007705cb-5258-468b-96a8-3ba8a5aeecfe tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:24.915493 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-007705cb-5258-468b-96a8-3ba8a5aeecfe tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:24.915975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-007705cb-5258-468b-96a8-3ba8a5aeecfe tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:24.916407 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-007705cb-5258-468b-96a8-3ba8a5aeecfe tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:25.093549 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-007705cb-5258-468b-96a8-3ba8a5aeecfe tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:25.101488 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-007705cb-5258-468b-96a8-3ba8a5aeecfe tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 200 len: 1367 microversion: 2.1 time: 0.199716 Sep 09 23:31:25.102068 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 528/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:24 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:26.125956 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-dfb8976b-da7c-4348-95e1-92abdb01fbef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:26.126755 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-dfb8976b-da7c-4348-95e1-92abdb01fbef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:26.128712 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:31:26.133539 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dfb8976b-da7c-4348-95e1-92abdb01fbef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:26.134025 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dfb8976b-da7c-4348-95e1-92abdb01fbef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:26.134745 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dfb8976b-da7c-4348-95e1-92abdb01fbef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:26.135446 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dfb8976b-da7c-4348-95e1-92abdb01fbef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:26.135898 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dfb8976b-da7c-4348-95e1-92abdb01fbef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:26.136323 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dfb8976b-da7c-4348-95e1-92abdb01fbef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:26.140328 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:31:26.311933 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-dfb8976b-da7c-4348-95e1-92abdb01fbef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:26.317334 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-dfb8976b-da7c-4348-95e1-92abdb01fbef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 200 len: 1367 microversion: 2.1 time: 0.196303 Sep 09 23:31:26.317997 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 500/1028] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:26 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:27.342090 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-aa6b6fd1-44e1-4540-bdd3-556c3e2a0848 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:27.343119 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-aa6b6fd1-44e1-4540-bdd3-556c3e2a0848 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:27.345676 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:31:27.351797 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa6b6fd1-44e1-4540-bdd3-556c3e2a0848 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:27.352292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa6b6fd1-44e1-4540-bdd3-556c3e2a0848 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:27.353214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa6b6fd1-44e1-4540-bdd3-556c3e2a0848 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:27.353906 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa6b6fd1-44e1-4540-bdd3-556c3e2a0848 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:27.354380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa6b6fd1-44e1-4540-bdd3-556c3e2a0848 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:27.354851 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-aa6b6fd1-44e1-4540-bdd3-556c3e2a0848 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:27.761071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-aa6b6fd1-44e1-4540-bdd3-556c3e2a0848 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:27.768740 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-aa6b6fd1-44e1-4540-bdd3-556c3e2a0848 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 200 len: 1367 microversion: 2.1 time: 0.430783 Sep 09 23:31:27.769296 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 529/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:27 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:28.746335 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-d23e9095-459b-4463-9347-3f36fc570f57 req-0723b026-93b8-4087-b3b0-5d0801e71a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07912acd-a498-4b7e-80ce-606d8970f528", "name": "network-vif-plugged", "status": "completed", "tag": "867923d7-36c4-4fc7-abe9-56b6959094a8"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:31:28.757639 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-d23e9095-459b-4463-9347-3f36fc570f57 req-0723b026-93b8-4087-b3b0-5d0801e71a1d service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:28.758113 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-d23e9095-459b-4463-9347-3f36fc570f57 req-0723b026-93b8-4087-b3b0-5d0801e71a1d service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:28.759141 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-d23e9095-459b-4463-9347-3f36fc570f57 req-0723b026-93b8-4087-b3b0-5d0801e71a1d service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:28.769777 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-d23e9095-459b-4463-9347-3f36fc570f57 req-0723b026-93b8-4087-b3b0-5d0801e71a1d service nova] Creating event network-vif-plugged:867923d7-36c4-4fc7-abe9-56b6959094a8 for instance 07912acd-a498-4b7e-80ce-606d8970f528 on hv-cinder-85032 Sep 09 23:31:28.775220 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-d23e9095-459b-4463-9347-3f36fc570f57 req-0723b026-93b8-4087-b3b0-5d0801e71a1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031955 Sep 09 23:31:28.775803 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 501/1030] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:31:28.792969 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4fb5acb5-5895-44ab-a1ba-ec26fac432af tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:28.793593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4fb5acb5-5895-44ab-a1ba-ec26fac432af tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:28.800444 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4fb5acb5-5895-44ab-a1ba-ec26fac432af tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:28.801140 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4fb5acb5-5895-44ab-a1ba-ec26fac432af tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:28.801893 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4fb5acb5-5895-44ab-a1ba-ec26fac432af tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:28.802632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4fb5acb5-5895-44ab-a1ba-ec26fac432af tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:28.803378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4fb5acb5-5895-44ab-a1ba-ec26fac432af tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:28.803819 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4fb5acb5-5895-44ab-a1ba-ec26fac432af tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:28.956923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4fb5acb5-5895-44ab-a1ba-ec26fac432af tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:28.974026 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4fb5acb5-5895-44ab-a1ba-ec26fac432af tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 200 len: 1367 microversion: 2.1 time: 0.176394 Sep 09 23:31:28.974026 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 530/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:28 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:29.989807 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-35f887bf-aff7-487e-98da-1dff4860a82a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:29.990533 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-35f887bf-aff7-487e-98da-1dff4860a82a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:29.998617 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-35f887bf-aff7-487e-98da-1dff4860a82a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:29.999084 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-35f887bf-aff7-487e-98da-1dff4860a82a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:29.999517 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-35f887bf-aff7-487e-98da-1dff4860a82a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:30.000202 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-35f887bf-aff7-487e-98da-1dff4860a82a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:30.000652 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-35f887bf-aff7-487e-98da-1dff4860a82a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:30.001094 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-35f887bf-aff7-487e-98da-1dff4860a82a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:30.136600 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-35f887bf-aff7-487e-98da-1dff4860a82a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:30.144313 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-35f887bf-aff7-487e-98da-1dff4860a82a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 200 len: 1367 microversion: 2.1 time: 0.159416 Sep 09 23:31:30.144888 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 502/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:29 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:31.168130 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-0289a946-f61b-4a58-bb98-29a592d5381b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:31.168746 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-0289a946-f61b-4a58-bb98-29a592d5381b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:31.171059 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=2 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:31:31.171725 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=6 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:31:31.176399 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0289a946-f61b-4a58-bb98-29a592d5381b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:31.176879 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0289a946-f61b-4a58-bb98-29a592d5381b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:31.177311 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0289a946-f61b-4a58-bb98-29a592d5381b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:31.177996 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0289a946-f61b-4a58-bb98-29a592d5381b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:31.178475 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0289a946-f61b-4a58-bb98-29a592d5381b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:31.178897 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-0289a946-f61b-4a58-bb98-29a592d5381b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:31.311167 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-0289a946-f61b-4a58-bb98-29a592d5381b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:31.318813 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-0289a946-f61b-4a58-bb98-29a592d5381b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 200 len: 1557 microversion: 2.1 time: 0.155322 Sep 09 23:31:31.319380 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 531/1033] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:31 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:31.342069 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1adfc59c-54aa-4b91-ab9c-ef4d1234464a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:31.342630 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-1adfc59c-54aa-4b91-ab9c-ef4d1234464a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:31.344521 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=6 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:31:31.349651 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1adfc59c-54aa-4b91-ab9c-ef4d1234464a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:31.350129 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1adfc59c-54aa-4b91-ab9c-ef4d1234464a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:31.350606 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1adfc59c-54aa-4b91-ab9c-ef4d1234464a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:31.351308 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1adfc59c-54aa-4b91-ab9c-ef4d1234464a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:31.351827 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1adfc59c-54aa-4b91-ab9c-ef4d1234464a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:31.352256 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1adfc59c-54aa-4b91-ab9c-ef4d1234464a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:31.432884 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-1adfc59c-54aa-4b91-ab9c-ef4d1234464a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095373 Sep 09 23:31:31.433476 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 503/1034] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 23:31:31 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:31:32.639833 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-b973b984-beb1-4670-859e-85a5dea5d9dd req-5c107083-b4b8-4a7d-b64a-16fbbe11a3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07912acd-a498-4b7e-80ce-606d8970f528", "tag": "867923d7-36c4-4fc7-abe9-56b6959094a8"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:31:32.650062 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-b973b984-beb1-4670-859e-85a5dea5d9dd req-5c107083-b4b8-4a7d-b64a-16fbbe11a3b0 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:32.650653 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-b973b984-beb1-4670-859e-85a5dea5d9dd req-5c107083-b4b8-4a7d-b64a-16fbbe11a3b0 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:32.651122 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-b973b984-beb1-4670-859e-85a5dea5d9dd req-5c107083-b4b8-4a7d-b64a-16fbbe11a3b0 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:32.662129 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-b973b984-beb1-4670-859e-85a5dea5d9dd req-5c107083-b4b8-4a7d-b64a-16fbbe11a3b0 service nova] Creating event network-changed:867923d7-36c4-4fc7-abe9-56b6959094a8 for instance 07912acd-a498-4b7e-80ce-606d8970f528 on hv-cinder-85032 Sep 09 23:31:32.667532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-b973b984-beb1-4670-859e-85a5dea5d9dd req-5c107083-b4b8-4a7d-b64a-16fbbe11a3b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031425 Sep 09 23:31:32.668131 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 532/1035] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:31:42.271983 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=7 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:31:42.272771 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=17 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:31:42.277885 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3ad85dac-6426-410e-84f1-5d69915abeda tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:42.281209 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3ad85dac-6426-410e-84f1-5d69915abeda tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:42.284418 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ad85dac-6426-410e-84f1-5d69915abeda tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:42.284905 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ad85dac-6426-410e-84f1-5d69915abeda tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:42.285345 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ad85dac-6426-410e-84f1-5d69915abeda tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:42.286036 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ad85dac-6426-410e-84f1-5d69915abeda tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:42.286544 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ad85dac-6426-410e-84f1-5d69915abeda tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:42.286979 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3ad85dac-6426-410e-84f1-5d69915abeda tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:42.312963 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3ad85dac-6426-410e-84f1-5d69915abeda tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Going to try to terminate instance {{(pid=121058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:31:42.597299 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3ad85dac-6426-410e-84f1-5d69915abeda tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "DELETE /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 204 len: 0 microversion: 2.1 time: 0.326385 Sep 09 23:31:42.597860 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 504/1036] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:31:42 2022] DELETE /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:31:42.608088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3b4fbd95-860d-462d-96ca-3a05b160dfa4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:42.608781 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3b4fbd95-860d-462d-96ca-3a05b160dfa4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:42.615221 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b4fbd95-860d-462d-96ca-3a05b160dfa4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:42.615707 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b4fbd95-860d-462d-96ca-3a05b160dfa4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:42.616145 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b4fbd95-860d-462d-96ca-3a05b160dfa4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:42.616833 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b4fbd95-860d-462d-96ca-3a05b160dfa4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:42.617295 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b4fbd95-860d-462d-96ca-3a05b160dfa4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:42.617724 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3b4fbd95-860d-462d-96ca-3a05b160dfa4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:42.746859 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3b4fbd95-860d-462d-96ca-3a05b160dfa4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:42.754642 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3b4fbd95-860d-462d-96ca-3a05b160dfa4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1580 microversion: 2.1 time: 0.152404 Sep 09 23:31:42.755205 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 533/1037] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:42 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1580 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:43.779622 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-dcc918ef-cea6-4c6a-87be-28298573f172 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:43.780266 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-dcc918ef-cea6-4c6a-87be-28298573f172 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:43.786586 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dcc918ef-cea6-4c6a-87be-28298573f172 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:43.787064 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dcc918ef-cea6-4c6a-87be-28298573f172 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:43.787495 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dcc918ef-cea6-4c6a-87be-28298573f172 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:43.788178 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dcc918ef-cea6-4c6a-87be-28298573f172 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:43.788630 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dcc918ef-cea6-4c6a-87be-28298573f172 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:43.789052 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-dcc918ef-cea6-4c6a-87be-28298573f172 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:43.923105 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-dcc918ef-cea6-4c6a-87be-28298573f172 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:43.930731 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-dcc918ef-cea6-4c6a-87be-28298573f172 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1580 microversion: 2.1 time: 0.155891 Sep 09 23:31:43.931798 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 505/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:43 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1580 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:44.954203 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-489c9070-db30-4f7c-bc63-089afb460052 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:44.954781 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-489c9070-db30-4f7c-bc63-089afb460052 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:44.961438 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-489c9070-db30-4f7c-bc63-089afb460052 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:44.961928 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-489c9070-db30-4f7c-bc63-089afb460052 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:44.962390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-489c9070-db30-4f7c-bc63-089afb460052 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:44.963189 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-489c9070-db30-4f7c-bc63-089afb460052 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:44.965173 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-489c9070-db30-4f7c-bc63-089afb460052 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:44.965617 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-489c9070-db30-4f7c-bc63-089afb460052 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:45.031019 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-489c9070-db30-4f7c-bc63-089afb460052 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:45.038853 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-489c9070-db30-4f7c-bc63-089afb460052 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1512 microversion: 2.1 time: 0.088598 Sep 09 23:31:45.039643 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 534/1039] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:44 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1512 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:45.394527 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-7298f86b-ce00-4fa5-98ba-cd46e09bbb55 req-9fd27a79-a999-448c-be47-7fe19ed56f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f980e0-fd89-4da8-a658-577721144b73", "name": "network-vif-deleted", "tag": "ce012a55-46cc-4eaf-94c4-5c066c18f1a2"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:31:45.407071 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-7298f86b-ce00-4fa5-98ba-cd46e09bbb55 req-9fd27a79-a999-448c-be47-7fe19ed56f17 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:45.407842 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-7298f86b-ce00-4fa5-98ba-cd46e09bbb55 req-9fd27a79-a999-448c-be47-7fe19ed56f17 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:45.408447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-7298f86b-ce00-4fa5-98ba-cd46e09bbb55 req-9fd27a79-a999-448c-be47-7fe19ed56f17 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:45.438387 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-7298f86b-ce00-4fa5-98ba-cd46e09bbb55 req-9fd27a79-a999-448c-be47-7fe19ed56f17 service nova] Creating event network-vif-deleted:ce012a55-46cc-4eaf-94c4-5c066c18f1a2 for instance 47f980e0-fd89-4da8-a658-577721144b73 on hv-cinder-85032 Sep 09 23:31:45.438387 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-7298f86b-ce00-4fa5-98ba-cd46e09bbb55 req-9fd27a79-a999-448c-be47-7fe19ed56f17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258429 Sep 09 23:31:45.438387 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 506/1040] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:31:46.064358 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-6166969d-054b-400a-9391-5b119b8499f9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:46.064997 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-6166969d-054b-400a-9391-5b119b8499f9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:46.071450 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6166969d-054b-400a-9391-5b119b8499f9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:46.072904 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6166969d-054b-400a-9391-5b119b8499f9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:46.073572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6166969d-054b-400a-9391-5b119b8499f9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:46.076011 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6166969d-054b-400a-9391-5b119b8499f9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:46.076509 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6166969d-054b-400a-9391-5b119b8499f9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:46.079201 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6166969d-054b-400a-9391-5b119b8499f9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:46.111976 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6166969d-054b-400a-9391-5b119b8499f9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:46.112468 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6166969d-054b-400a-9391-5b119b8499f9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:46.113173 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-6166969d-054b-400a-9391-5b119b8499f9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:46.113625 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-6166969d-054b-400a-9391-5b119b8499f9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lazy-loading 'fault' on Instance uuid 47f980e0-fd89-4da8-a658-577721144b73 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:31:46.156777 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-6166969d-054b-400a-9391-5b119b8499f9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:46.164856 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-6166969d-054b-400a-9391-5b119b8499f9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 200 len: 1231 microversion: 2.1 time: 0.104423 Sep 09 23:31:46.165435 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 535/1041] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:46 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 1231 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:47.188505 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-42280069-faf0-498e-80b3-4a548fd0dcb1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:47.189205 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-42280069-faf0-498e-80b3-4a548fd0dcb1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:47.195339 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-42280069-faf0-498e-80b3-4a548fd0dcb1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:47.195817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-42280069-faf0-498e-80b3-4a548fd0dcb1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:47.196252 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-42280069-faf0-498e-80b3-4a548fd0dcb1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:47.197468 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-42280069-faf0-498e-80b3-4a548fd0dcb1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:47.198012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-42280069-faf0-498e-80b3-4a548fd0dcb1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:47.198464 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-42280069-faf0-498e-80b3-4a548fd0dcb1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:47.211327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-42280069-faf0-498e-80b3-4a548fd0dcb1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] HTTP exception thrown: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-42280069-faf0-498e-80b3-4a548fd0dcb1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Request method failure captured: Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 HTTP/1.1 Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8w1jhDZJe0FlEHFn-Uk3JIz2iO-zQw8kgYSPCECy1gvaKWNHHmi9qfeJ8dL8KBR9xLyhJjx-YPB-onU_SL1WA92vQmhaLX903PFXCOXoS2_ZUvYsLbR1xcv8oIkbHwphE3Ud0RfReWw4dVzeF0H1d6p_HOwpobgoO5WYl8Baq9M0nM Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 8042eb99cd7047d4912b2f4b1e50936e Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-TestVolumeBootPattern-318475639 Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:31:47.213520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:31:47.215322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8042eb99cd7047d4912b2f4b1e50936e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8042eb99cd7047d4912b2f4b1e50936e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8042eb99cd7047d4912b2f4b1e50936e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8042eb99cd7047d4912b2f4b1e50936e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:31:47.215322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-TestVolumeBootPattern-318475639 Sep 09 23:31:47.215322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 8042eb99cd7047d4912b2f4b1e50936e Sep 09 23:31:47.215322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-TestVolumeBootPattern-318475639 Sep 09 23:31:47.215322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-TestVolumeBootPattern-318475639-project Sep 09 23:31:47.215322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:31:47.215322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:31:47.215322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 8c81c0af6f084b8db165fd51667b3b54 Sep 09 23:31:47.215322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-TestVolumeBootPattern-318475639-project Sep 09 23:31:47.215322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:31:47.215322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. Sep 09 23:31:47.215322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '47f980e0-fd89-4da8-a658-577721144b73'} Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:31:47.216294 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. Sep 09 23:31:47.217962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:31:47.219410 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-42280069-faf0-498e-80b3-4a548fd0dcb1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Returning 404 to user: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:31:47.219410 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-42280069-faf0-498e-80b3-4a548fd0dcb1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 404 len: 111 microversion: 2.1 time: 0.031046 Sep 09 23:31:47.219410 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 507/1042] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:47 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:31:47.310887 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1611624358", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1647096225", "security_groups": [{"name": "tempest-secgroup-smoke-1193112495"}], "block_device_mapping_v2": [{"uuid": "6df02f2b-70bb-4c63-88fd-39712b1e8ef8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7fd7062d-e427-4fda-80b7-f6a7278968d0"}]}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:31:47.440519 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.network.neutron [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] validate_networks() for [('7fd7062d-e427-4fda-80b7-f6a7278968d0', None, None, None, None, None)] {{(pid=121059) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:31:47.909331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Flavor limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:31:47.909758 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Image limits 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:31:47.910232 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Flavor pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:31:47.910677 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Image pref 0:0:0 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:31:47.911092 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.virt.hardware [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:31:47.920552 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:47.921029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:47.921466 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:47.922196 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:47.922691 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:47.923117 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:47.940221 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Getting quotas for project 8042eb99cd7047d4912b2f4b1e50936e. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:31:47.944143 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Getting quotas for user 8c81c0af6f084b8db165fd51667b3b54 and project 8042eb99cd7047d4912b2f4b1e50936e. Resources: {'cores', 'instances', 'ram'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:31:48.001521 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Going to run 1 instances... {{(pid=121059) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:31:48.003653 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6df02f2b-70bb-4c63-88fd-39712b1e8ef8',volume_size=None,volume_type=None)] {{(pid=121059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:31:48.410135 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-089cc42d-0acc-47d5-a9af-d869c5ed3825 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.103337 Sep 09 23:31:48.411711 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 536/1043] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:31:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:31:48.422834 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a94be80d-44af-41d8-8d75-251abdf08f2b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:48.423313 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a94be80d-44af-41d8-8d75-251abdf08f2b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:48.481386 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a94be80d-44af-41d8-8d75-251abdf08f2b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:48.488878 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a94be80d-44af-41d8-8d75-251abdf08f2b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1095 microversion: 2.1 time: 0.070058 Sep 09 23:31:48.489444 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 508/1044] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:48 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:49.511925 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7536efae-ed3f-4b15-bbc7-471e81b23d7b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:49.512572 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7536efae-ed3f-4b15-bbc7-471e81b23d7b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:49.518852 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7536efae-ed3f-4b15-bbc7-471e81b23d7b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:49.519975 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7536efae-ed3f-4b15-bbc7-471e81b23d7b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:49.520521 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7536efae-ed3f-4b15-bbc7-471e81b23d7b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:49.521196 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7536efae-ed3f-4b15-bbc7-471e81b23d7b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:49.521660 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7536efae-ed3f-4b15-bbc7-471e81b23d7b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:49.522095 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7536efae-ed3f-4b15-bbc7-471e81b23d7b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:49.584153 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7536efae-ed3f-4b15-bbc7-471e81b23d7b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:49.592906 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7536efae-ed3f-4b15-bbc7-471e81b23d7b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1145 microversion: 2.1 time: 0.085564 Sep 09 23:31:49.598508 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 537/1045] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:49 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:50.616747 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9f649599-7710-4880-a2cf-430aae4b26fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:50.617608 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9f649599-7710-4880-a2cf-430aae4b26fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:50.625646 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9f649599-7710-4880-a2cf-430aae4b26fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:50.626183 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9f649599-7710-4880-a2cf-430aae4b26fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:50.626645 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9f649599-7710-4880-a2cf-430aae4b26fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:50.627555 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9f649599-7710-4880-a2cf-430aae4b26fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:50.628220 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9f649599-7710-4880-a2cf-430aae4b26fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:50.628825 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9f649599-7710-4880-a2cf-430aae4b26fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:50.693957 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9f649599-7710-4880-a2cf-430aae4b26fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:50.702176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9f649599-7710-4880-a2cf-430aae4b26fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1201 microversion: 2.1 time: 0.089545 Sep 09 23:31:50.702766 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 509/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:50 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:51.725600 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7968b0d5-632d-443e-896d-340a5c13ca33 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:51.726230 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7968b0d5-632d-443e-896d-340a5c13ca33 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:51.739378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7968b0d5-632d-443e-896d-340a5c13ca33 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:51.739378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7968b0d5-632d-443e-896d-340a5c13ca33 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:51.740262 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7968b0d5-632d-443e-896d-340a5c13ca33 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:51.741760 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7968b0d5-632d-443e-896d-340a5c13ca33 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:51.742740 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7968b0d5-632d-443e-896d-340a5c13ca33 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:51.743729 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7968b0d5-632d-443e-896d-340a5c13ca33 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:51.880473 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7968b0d5-632d-443e-896d-340a5c13ca33 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:51.888642 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7968b0d5-632d-443e-896d-340a5c13ca33 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1279 microversion: 2.1 time: 0.167152 Sep 09 23:31:51.893217 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 538/1047] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:51 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1279 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:52.279090 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-797d03c1-536d-470d-a1b0-20ed9c0ebfe7 req-4704ee13-fe84-4152-b554-460c54807aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75316fb8-2a0f-4676-8896-d90ca8e9419c", "tag": "783bedf3-9fb9-4027-bf33-a7a0ccbdc941"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:31:52.289049 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-797d03c1-536d-470d-a1b0-20ed9c0ebfe7 req-4704ee13-fe84-4152-b554-460c54807aa4 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:52.289524 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-797d03c1-536d-470d-a1b0-20ed9c0ebfe7 req-4704ee13-fe84-4152-b554-460c54807aa4 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:52.289966 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-797d03c1-536d-470d-a1b0-20ed9c0ebfe7 req-4704ee13-fe84-4152-b554-460c54807aa4 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:52.301946 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-797d03c1-536d-470d-a1b0-20ed9c0ebfe7 req-4704ee13-fe84-4152-b554-460c54807aa4 service nova] Creating event network-changed:783bedf3-9fb9-4027-bf33-a7a0ccbdc941 for instance 75316fb8-2a0f-4676-8896-d90ca8e9419c on hv-cinder-85032 Sep 09 23:31:52.313853 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-797d03c1-536d-470d-a1b0-20ed9c0ebfe7 req-4704ee13-fe84-4152-b554-460c54807aa4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039641 Sep 09 23:31:52.324943 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 510/1048] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:31:52.911505 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-504b40e9-10b8-45fd-8ba8-cda037f9887d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:52.912114 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-504b40e9-10b8-45fd-8ba8-cda037f9887d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:52.919268 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-504b40e9-10b8-45fd-8ba8-cda037f9887d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:52.919749 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-504b40e9-10b8-45fd-8ba8-cda037f9887d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:52.920182 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-504b40e9-10b8-45fd-8ba8-cda037f9887d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:52.920878 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-504b40e9-10b8-45fd-8ba8-cda037f9887d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:52.921331 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-504b40e9-10b8-45fd-8ba8-cda037f9887d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:52.921754 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-504b40e9-10b8-45fd-8ba8-cda037f9887d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:53.055232 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-504b40e9-10b8-45fd-8ba8-cda037f9887d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:53.063568 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-504b40e9-10b8-45fd-8ba8-cda037f9887d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1267 microversion: 2.1 time: 0.156106 Sep 09 23:31:53.064131 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 539/1049] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:52 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:54.087323 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-39f6c2ef-91d0-4753-bc64-3971df5b6e4b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:54.088125 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-39f6c2ef-91d0-4753-bc64-3971df5b6e4b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:54.094831 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39f6c2ef-91d0-4753-bc64-3971df5b6e4b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:54.095317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39f6c2ef-91d0-4753-bc64-3971df5b6e4b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:54.095788 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39f6c2ef-91d0-4753-bc64-3971df5b6e4b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:54.096481 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39f6c2ef-91d0-4753-bc64-3971df5b6e4b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:54.096937 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39f6c2ef-91d0-4753-bc64-3971df5b6e4b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:54.097387 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-39f6c2ef-91d0-4753-bc64-3971df5b6e4b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:54.240773 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-39f6c2ef-91d0-4753-bc64-3971df5b6e4b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:54.249414 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-39f6c2ef-91d0-4753-bc64-3971df5b6e4b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1267 microversion: 2.1 time: 0.166341 Sep 09 23:31:54.249986 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 511/1050] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:54 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:55.272567 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fba30989-c578-45f0-b163-0c2f50620d06 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:55.273086 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-fba30989-c578-45f0-b163-0c2f50620d06 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:55.279673 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fba30989-c578-45f0-b163-0c2f50620d06 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:55.280166 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fba30989-c578-45f0-b163-0c2f50620d06 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:55.280604 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fba30989-c578-45f0-b163-0c2f50620d06 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:55.281294 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fba30989-c578-45f0-b163-0c2f50620d06 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:55.281753 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fba30989-c578-45f0-b163-0c2f50620d06 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:55.282180 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fba30989-c578-45f0-b163-0c2f50620d06 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:55.284829 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=77 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:31:55.411890 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fba30989-c578-45f0-b163-0c2f50620d06 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:55.420682 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-fba30989-c578-45f0-b163-0c2f50620d06 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1267 microversion: 2.1 time: 0.152028 Sep 09 23:31:55.421265 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 540/1051] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:55 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:56.448528 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-21676a6e-9ec2-4715-a071-7b568949342f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:56.449630 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-21676a6e-9ec2-4715-a071-7b568949342f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:56.457653 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-21676a6e-9ec2-4715-a071-7b568949342f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:56.458142 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-21676a6e-9ec2-4715-a071-7b568949342f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:56.458616 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-21676a6e-9ec2-4715-a071-7b568949342f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:56.459320 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-21676a6e-9ec2-4715-a071-7b568949342f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:56.459782 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-21676a6e-9ec2-4715-a071-7b568949342f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:56.460220 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-21676a6e-9ec2-4715-a071-7b568949342f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:56.594579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-21676a6e-9ec2-4715-a071-7b568949342f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:56.602129 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-21676a6e-9ec2-4715-a071-7b568949342f tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1267 microversion: 2.1 time: 0.158798 Sep 09 23:31:56.602721 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 512/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:56 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:57.625885 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8b403324-a7e2-4b24-af21-491844ad6771 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:57.626526 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8b403324-a7e2-4b24-af21-491844ad6771 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:57.632613 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b403324-a7e2-4b24-af21-491844ad6771 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:57.633089 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b403324-a7e2-4b24-af21-491844ad6771 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:57.633520 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b403324-a7e2-4b24-af21-491844ad6771 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:57.634711 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b403324-a7e2-4b24-af21-491844ad6771 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:57.635174 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b403324-a7e2-4b24-af21-491844ad6771 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:57.635600 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8b403324-a7e2-4b24-af21-491844ad6771 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:57.769734 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-8b403324-a7e2-4b24-af21-491844ad6771 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:57.778485 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8b403324-a7e2-4b24-af21-491844ad6771 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1267 microversion: 2.1 time: 0.156445 Sep 09 23:31:57.779057 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 541/1053] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:57 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:58.801125 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c0d6208b-42f3-4d8c-a70b-0ddd2d9d1ebb tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:58.801645 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c0d6208b-42f3-4d8c-a70b-0ddd2d9d1ebb tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:58.804034 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=2 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:31:58.808879 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c0d6208b-42f3-4d8c-a70b-0ddd2d9d1ebb tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:58.809353 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c0d6208b-42f3-4d8c-a70b-0ddd2d9d1ebb tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:58.809787 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c0d6208b-42f3-4d8c-a70b-0ddd2d9d1ebb tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:58.810497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c0d6208b-42f3-4d8c-a70b-0ddd2d9d1ebb tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:58.819548 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c0d6208b-42f3-4d8c-a70b-0ddd2d9d1ebb tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:58.819548 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c0d6208b-42f3-4d8c-a70b-0ddd2d9d1ebb tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:58.939638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c0d6208b-42f3-4d8c-a70b-0ddd2d9d1ebb tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:31:58.947249 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c0d6208b-42f3-4d8c-a70b-0ddd2d9d1ebb tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1267 microversion: 2.1 time: 0.150077 Sep 09 23:31:58.947780 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 513/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:58 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:31:59.969584 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-54675e36-34bf-4437-94dd-878a9f5cb7d1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:31:59.970221 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-54675e36-34bf-4437-94dd-878a9f5cb7d1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:31:59.972090 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=2 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:31:59.972897 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=6 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:31:59.973967 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:31:59.979427 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54675e36-34bf-4437-94dd-878a9f5cb7d1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:59.981437 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54675e36-34bf-4437-94dd-878a9f5cb7d1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:59.981437 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54675e36-34bf-4437-94dd-878a9f5cb7d1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:31:59.981437 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54675e36-34bf-4437-94dd-878a9f5cb7d1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:31:59.981437 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54675e36-34bf-4437-94dd-878a9f5cb7d1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:31:59.982230 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-54675e36-34bf-4437-94dd-878a9f5cb7d1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:00.112219 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-54675e36-34bf-4437-94dd-878a9f5cb7d1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:00.120476 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-54675e36-34bf-4437-94dd-878a9f5cb7d1 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1267 microversion: 2.1 time: 0.154805 Sep 09 23:32:00.121034 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 542/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:31:59 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:01.143698 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9d94d153-4f84-4156-8fc4-f81ab986a8fc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:01.144329 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9d94d153-4f84-4156-8fc4-f81ab986a8fc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:01.151359 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9d94d153-4f84-4156-8fc4-f81ab986a8fc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:01.151850 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9d94d153-4f84-4156-8fc4-f81ab986a8fc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:01.152266 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9d94d153-4f84-4156-8fc4-f81ab986a8fc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:01.152947 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9d94d153-4f84-4156-8fc4-f81ab986a8fc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:01.153400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9d94d153-4f84-4156-8fc4-f81ab986a8fc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:01.153823 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9d94d153-4f84-4156-8fc4-f81ab986a8fc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:01.286927 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9d94d153-4f84-4156-8fc4-f81ab986a8fc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:01.294783 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9d94d153-4f84-4156-8fc4-f81ab986a8fc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1267 microversion: 2.1 time: 0.154949 Sep 09 23:32:01.295368 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 514/1056] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:01 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:02.319072 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5f1a4fd0-ea6c-46a0-812b-3c0cfbea60b6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:02.319672 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5f1a4fd0-ea6c-46a0-812b-3c0cfbea60b6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:02.327131 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5f1a4fd0-ea6c-46a0-812b-3c0cfbea60b6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:02.328272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5f1a4fd0-ea6c-46a0-812b-3c0cfbea60b6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:02.328272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5f1a4fd0-ea6c-46a0-812b-3c0cfbea60b6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:02.328753 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5f1a4fd0-ea6c-46a0-812b-3c0cfbea60b6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:02.329205 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5f1a4fd0-ea6c-46a0-812b-3c0cfbea60b6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:02.329625 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5f1a4fd0-ea6c-46a0-812b-3c0cfbea60b6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:02.465570 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5f1a4fd0-ea6c-46a0-812b-3c0cfbea60b6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:02.473208 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5f1a4fd0-ea6c-46a0-812b-3c0cfbea60b6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1267 microversion: 2.1 time: 0.158514 Sep 09 23:32:02.473766 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 543/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:02 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:02.990549 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-93f08ab8-44b0-480f-a7f5-fa69862567c9 req-4117b8e3-47bd-466b-92ba-eee0061513a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75316fb8-2a0f-4676-8896-d90ca8e9419c", "name": "network-vif-plugged", "status": "completed", "tag": "783bedf3-9fb9-4027-bf33-a7a0ccbdc941"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:32:03.000932 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-93f08ab8-44b0-480f-a7f5-fa69862567c9 req-4117b8e3-47bd-466b-92ba-eee0061513a1 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:03.001410 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-93f08ab8-44b0-480f-a7f5-fa69862567c9 req-4117b8e3-47bd-466b-92ba-eee0061513a1 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:03.001878 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-93f08ab8-44b0-480f-a7f5-fa69862567c9 req-4117b8e3-47bd-466b-92ba-eee0061513a1 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:03.013095 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-93f08ab8-44b0-480f-a7f5-fa69862567c9 req-4117b8e3-47bd-466b-92ba-eee0061513a1 service nova] Creating event network-vif-plugged:783bedf3-9fb9-4027-bf33-a7a0ccbdc941 for instance 75316fb8-2a0f-4676-8896-d90ca8e9419c on hv-cinder-85032 Sep 09 23:32:03.019433 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-93f08ab8-44b0-480f-a7f5-fa69862567c9 req-4117b8e3-47bd-466b-92ba-eee0061513a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091063 Sep 09 23:32:03.020054 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 515/1058] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:32:03.496852 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7ff9c4e1-f44d-499b-9790-c95d22bc9276 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:03.497462 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7ff9c4e1-f44d-499b-9790-c95d22bc9276 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:03.503913 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7ff9c4e1-f44d-499b-9790-c95d22bc9276 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:03.504397 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7ff9c4e1-f44d-499b-9790-c95d22bc9276 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:03.504830 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7ff9c4e1-f44d-499b-9790-c95d22bc9276 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:03.505514 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7ff9c4e1-f44d-499b-9790-c95d22bc9276 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:03.505971 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7ff9c4e1-f44d-499b-9790-c95d22bc9276 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:03.506415 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7ff9c4e1-f44d-499b-9790-c95d22bc9276 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:03.639390 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-7ff9c4e1-f44d-499b-9790-c95d22bc9276 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:03.647011 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7ff9c4e1-f44d-499b-9790-c95d22bc9276 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1267 microversion: 2.1 time: 0.154544 Sep 09 23:32:03.647574 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 544/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:03 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:04.672284 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-960ab100-09ba-4a3e-8253-e24e7092641b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:04.672910 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-960ab100-09ba-4a3e-8253-e24e7092641b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:04.679086 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-960ab100-09ba-4a3e-8253-e24e7092641b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:04.679570 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-960ab100-09ba-4a3e-8253-e24e7092641b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:04.680007 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-960ab100-09ba-4a3e-8253-e24e7092641b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:04.680701 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-960ab100-09ba-4a3e-8253-e24e7092641b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:04.681806 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-960ab100-09ba-4a3e-8253-e24e7092641b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:04.682242 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-960ab100-09ba-4a3e-8253-e24e7092641b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:04.814903 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-960ab100-09ba-4a3e-8253-e24e7092641b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:04.823762 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-960ab100-09ba-4a3e-8253-e24e7092641b tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1455 microversion: 2.1 time: 0.156266 Sep 09 23:32:04.824356 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 516/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:04 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:32:04.845769 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-402f3904-5c20-48c7-aeb2-f5df17a5240e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:04.846401 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-402f3904-5c20-48c7-aeb2-f5df17a5240e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:04.852908 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-402f3904-5c20-48c7-aeb2-f5df17a5240e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:04.853594 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-402f3904-5c20-48c7-aeb2-f5df17a5240e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:04.854038 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-402f3904-5c20-48c7-aeb2-f5df17a5240e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:04.854757 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-402f3904-5c20-48c7-aeb2-f5df17a5240e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:04.855238 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-402f3904-5c20-48c7-aeb2-f5df17a5240e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:04.855660 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-402f3904-5c20-48c7-aeb2-f5df17a5240e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:04.988537 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-402f3904-5c20-48c7-aeb2-f5df17a5240e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:04.996947 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-402f3904-5c20-48c7-aeb2-f5df17a5240e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1455 microversion: 2.1 time: 0.155004 Sep 09 23:32:04.997511 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 545/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:04 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:32:06.896091 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-0611a0e9-4a98-4d7e-9b8a-18472b0a8958 req-05faa3fd-3280-4d40-b54e-b351386322a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75316fb8-2a0f-4676-8896-d90ca8e9419c", "tag": "783bedf3-9fb9-4027-bf33-a7a0ccbdc941"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:32:06.906189 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-0611a0e9-4a98-4d7e-9b8a-18472b0a8958 req-05faa3fd-3280-4d40-b54e-b351386322a9 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:06.906698 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-0611a0e9-4a98-4d7e-9b8a-18472b0a8958 req-05faa3fd-3280-4d40-b54e-b351386322a9 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:06.907150 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-0611a0e9-4a98-4d7e-9b8a-18472b0a8958 req-05faa3fd-3280-4d40-b54e-b351386322a9 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:06.918227 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-0611a0e9-4a98-4d7e-9b8a-18472b0a8958 req-05faa3fd-3280-4d40-b54e-b351386322a9 service nova] Creating event network-changed:783bedf3-9fb9-4027-bf33-a7a0ccbdc941 for instance 75316fb8-2a0f-4676-8896-d90ca8e9419c on hv-cinder-85032 Sep 09 23:32:06.923233 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-0611a0e9-4a98-4d7e-9b8a-18472b0a8958 req-05faa3fd-3280-4d40-b54e-b351386322a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088418 Sep 09 23:32:06.924818 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 517/1062] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:32:08.745125 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-df27bc81-f418-43f8-9f2b-62c9b545aacf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:08.745660 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-df27bc81-f418-43f8-9f2b-62c9b545aacf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:08.752385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-df27bc81-f418-43f8-9f2b-62c9b545aacf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:08.752868 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-df27bc81-f418-43f8-9f2b-62c9b545aacf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:08.753299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-df27bc81-f418-43f8-9f2b-62c9b545aacf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:08.753983 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-df27bc81-f418-43f8-9f2b-62c9b545aacf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:08.754457 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-df27bc81-f418-43f8-9f2b-62c9b545aacf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:08.754878 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-df27bc81-f418-43f8-9f2b-62c9b545aacf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:08.778009 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-df27bc81-f418-43f8-9f2b-62c9b545aacf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528/ips" status: 200 len: 150 microversion: 2.1 time: 0.037631 Sep 09 23:32:08.778664 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 546/1063] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 23:32:08 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:32:10.386541 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e120c220-12b8-4f16-a076-fea3533c9352 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3b49d1b-cb3b-4c00-9b65-d49ee7c574a0"}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:32:10.389049 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e120c220-12b8-4f16-a076-fea3533c9352 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:10.395191 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e120c220-12b8-4f16-a076-fea3533c9352 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:10.395678 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e120c220-12b8-4f16-a076-fea3533c9352 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:10.396115 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e120c220-12b8-4f16-a076-fea3533c9352 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:10.396808 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e120c220-12b8-4f16-a076-fea3533c9352 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:10.397263 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e120c220-12b8-4f16-a076-fea3533c9352 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:10.397687 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e120c220-12b8-4f16-a076-fea3533c9352 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:10.997040 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e120c220-12b8-4f16-a076-fea3533c9352 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "POST /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.616315 Sep 09 23:32:10.997661 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 518/1064] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 23:32:10 2022] POST /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528/os-volume_attachments => generated 194 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:32:18.553252 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7d64ad54-ace1-4224-b90e-470113af08e5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3b49d1b-cb3b-4c00-9b65-d49ee7c574a0"}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:32:18.555715 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7d64ad54-ace1-4224-b90e-470113af08e5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:18.562288 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7d64ad54-ace1-4224-b90e-470113af08e5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:18.562808 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7d64ad54-ace1-4224-b90e-470113af08e5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:18.563248 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7d64ad54-ace1-4224-b90e-470113af08e5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:18.563947 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7d64ad54-ace1-4224-b90e-470113af08e5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:18.564409 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7d64ad54-ace1-4224-b90e-470113af08e5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:18.564843 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7d64ad54-ace1-4224-b90e-470113af08e5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:18.642914 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-7d64ad54-ace1-4224-b90e-470113af08e5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] HTTP exception thrown: Invalid volume: volume d3b49d1b-cb3b-4c00-9b65-d49ee7c574a0 is already attached to instances: 07912acd-a498-4b7e-80ce-606d8970f528 Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7d64ad54-ace1-4224-b90e-470113af08e5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Request method failure captured: Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: POST /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528/os-volume_attachments HTTP/1.1 Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 74 Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8woRMVyoU9aLaBHLfxWq3rhgSNfpDXsHrJ0JUVxxXk7N_vHMOu7IKDmy7Ln-hyMIN_NjduqULel4lJLROHRtQ-6Op9IQi2psaTOuqyihyzV19hZ7jrQEMS9G45jhSxfqzPTvA4Ts62X0j3XSTOZ7Ne8N5xbdyc_SaHiCOAAIt150ZA Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:32:18.644654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:32:18.646378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d57c38134f1484d9b208de1b9d8e26e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:32:18.646378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:32:18.646378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:32:18.646378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:32:18.646378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:32:18.646378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:32:18.646378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:32:18.646378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 592da799f0c540d68a2cc6d54006467c Sep 09 23:32:18.646378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:32:18.646378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Sep 09 23:32:18.646378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {"volumeAttachment": {"volumeId": "d3b49d1b-cb3b-4c00-9b65-d49ee7c574a0"}} Sep 09 23:32:18.646378 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Invalid volume: volume d3b49d1b-cb3b-4c00-9b65-d49ee7c574a0 is already attached to instances: 07912acd-a498-4b7e-80ce-606d8970f528 Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'server_id': '07912acd-a498-4b7e-80ce-606d8970f528', 'body': {'volumeAttachment': {'volumeId': 'd3b49d1b-cb3b-4c00-9b65-d49ee7c574a0'}}} Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d3b49d1b-cb3b-4c00-9b65-d49ee7c574a0 is already attached to instances: 07912acd-a498-4b7e-80ce-606d8970f528 Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:32:18.647337 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d3b49d1b-cb3b-4c00-9b65-d49ee7c574a0 is already attached to instances: 07912acd-a498-4b7e-80ce-606d8970f528 Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:32:18.648828 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:32:18.650756 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:32:18.650756 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:32:18.650756 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:32:18.650756 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d3b49d1b-cb3b-4c00-9b65-d49ee7c574a0 is already attached to instances: 07912acd-a498-4b7e-80ce-606d8970f528 Sep 09 23:32:18.650756 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:32:18.650756 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7d64ad54-ace1-4224-b90e-470113af08e5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Returning 400 to user: Invalid volume: volume d3b49d1b-cb3b-4c00-9b65-d49ee7c574a0 is already attached to instances: 07912acd-a498-4b7e-80ce-606d8970f528 {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:32:18.650756 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7d64ad54-ace1-4224-b90e-470113af08e5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "POST /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096906 Sep 09 23:32:18.650756 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 547/1065] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 23:32:18 2022] POST /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 09 23:32:18.715858 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-01e4bd25-7c5c-4ad4-aeac-e2ccff33e01a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:18.716447 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-01e4bd25-7c5c-4ad4-aeac-e2ccff33e01a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:18.718440 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:32:18.723235 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01e4bd25-7c5c-4ad4-aeac-e2ccff33e01a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:18.723720 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01e4bd25-7c5c-4ad4-aeac-e2ccff33e01a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:18.724160 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01e4bd25-7c5c-4ad4-aeac-e2ccff33e01a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:18.724852 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01e4bd25-7c5c-4ad4-aeac-e2ccff33e01a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:18.725307 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01e4bd25-7c5c-4ad4-aeac-e2ccff33e01a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:18.725733 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-01e4bd25-7c5c-4ad4-aeac-e2ccff33e01a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:18.730576 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:32:18.808131 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-01e4bd25-7c5c-4ad4-aeac-e2ccff33e01a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lazy-loading 'services' on Instance uuid 07912acd-a498-4b7e-80ce-606d8970f528 {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:32:19.003562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-01e4bd25-7c5c-4ad4-aeac-e2ccff33e01a tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "DELETE /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528/os-volume_attachments/d3b49d1b-cb3b-4c00-9b65-d49ee7c574a0" status: 202 len: 0 microversion: 2.1 time: 0.292886 Sep 09 23:32:19.004166 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 519/1066] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 23:32:18 2022] DELETE /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528/os-volume_attachments/d3b49d1b-cb3b-4c00-9b65-d49ee7c574a0 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:32:19.018000 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8d7df6ec-48e0-4de1-b227-e396431f7c74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:19.020354 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8d7df6ec-48e0-4de1-b227-e396431f7c74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:19.028012 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d7df6ec-48e0-4de1-b227-e396431f7c74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:19.028491 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d7df6ec-48e0-4de1-b227-e396431f7c74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:19.028926 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d7df6ec-48e0-4de1-b227-e396431f7c74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:19.029621 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d7df6ec-48e0-4de1-b227-e396431f7c74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:19.030070 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d7df6ec-48e0-4de1-b227-e396431f7c74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:19.030562 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d7df6ec-48e0-4de1-b227-e396431f7c74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:19.059987 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8d7df6ec-48e0-4de1-b227-e396431f7c74 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051396 Sep 09 23:32:19.060541 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 548/1067] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:32:19 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:32:20.073625 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4d67785d-2e19-468f-85ee-37b8d8dd01cf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:20.075899 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4d67785d-2e19-468f-85ee-37b8d8dd01cf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:20.081912 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4d67785d-2e19-468f-85ee-37b8d8dd01cf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:20.084616 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4d67785d-2e19-468f-85ee-37b8d8dd01cf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:20.084616 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4d67785d-2e19-468f-85ee-37b8d8dd01cf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:20.084616 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4d67785d-2e19-468f-85ee-37b8d8dd01cf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:20.084616 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4d67785d-2e19-468f-85ee-37b8d8dd01cf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:20.085050 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4d67785d-2e19-468f-85ee-37b8d8dd01cf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:20.114431 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4d67785d-2e19-468f-85ee-37b8d8dd01cf tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046132 Sep 09 23:32:20.114989 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 520/1068] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:32:20 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:32:20.177650 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-12579974-8011-43d6-bdb8-52edee6344db tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:20.178185 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-12579974-8011-43d6-bdb8-52edee6344db tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:20.185291 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12579974-8011-43d6-bdb8-52edee6344db tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:20.185776 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12579974-8011-43d6-bdb8-52edee6344db tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:20.186214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12579974-8011-43d6-bdb8-52edee6344db tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:20.186934 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12579974-8011-43d6-bdb8-52edee6344db tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:20.187393 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12579974-8011-43d6-bdb8-52edee6344db tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:20.187818 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-12579974-8011-43d6-bdb8-52edee6344db tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:20.213519 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-12579974-8011-43d6-bdb8-52edee6344db tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Going to try to terminate instance {{(pid=121059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:32:20.558455 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-12579974-8011-43d6-bdb8-52edee6344db tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "DELETE /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 204 len: 0 microversion: 2.1 time: 0.384440 Sep 09 23:32:20.559116 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 549/1069] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:32:20 2022] DELETE /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:32:20.567229 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c090fc8d-5d26-4264-b25d-189dc3dad2ed tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:20.567849 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c090fc8d-5d26-4264-b25d-189dc3dad2ed tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:20.573912 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c090fc8d-5d26-4264-b25d-189dc3dad2ed tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:20.574481 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c090fc8d-5d26-4264-b25d-189dc3dad2ed tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:20.574939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c090fc8d-5d26-4264-b25d-189dc3dad2ed tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:20.575636 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c090fc8d-5d26-4264-b25d-189dc3dad2ed tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:20.576099 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c090fc8d-5d26-4264-b25d-189dc3dad2ed tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:20.576529 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c090fc8d-5d26-4264-b25d-189dc3dad2ed tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:20.706789 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c090fc8d-5d26-4264-b25d-189dc3dad2ed tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:20.715226 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c090fc8d-5d26-4264-b25d-189dc3dad2ed tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 200 len: 1682 microversion: 2.1 time: 0.151856 Sep 09 23:32:20.715799 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 521/1070] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:20 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:21.740923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e3018dfb-acdc-4e0a-9233-8e627133b83e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:21.741608 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e3018dfb-acdc-4e0a-9233-8e627133b83e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:21.749072 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3018dfb-acdc-4e0a-9233-8e627133b83e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:21.749591 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3018dfb-acdc-4e0a-9233-8e627133b83e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:21.750038 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3018dfb-acdc-4e0a-9233-8e627133b83e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:21.750794 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3018dfb-acdc-4e0a-9233-8e627133b83e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:21.751256 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3018dfb-acdc-4e0a-9233-8e627133b83e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:21.751690 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e3018dfb-acdc-4e0a-9233-8e627133b83e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:21.887053 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e3018dfb-acdc-4e0a-9233-8e627133b83e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:21.894682 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e3018dfb-acdc-4e0a-9233-8e627133b83e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 200 len: 1682 microversion: 2.1 time: 0.158574 Sep 09 23:32:21.895243 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 550/1071] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:21 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:22.918118 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b8b2f98d-d61d-4241-b104-057756aefbbb tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:22.918758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-b8b2f98d-d61d-4241-b104-057756aefbbb tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:22.925240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b8b2f98d-d61d-4241-b104-057756aefbbb tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:22.925722 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b8b2f98d-d61d-4241-b104-057756aefbbb tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:22.930296 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b8b2f98d-d61d-4241-b104-057756aefbbb tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:22.930296 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b8b2f98d-d61d-4241-b104-057756aefbbb tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:22.930296 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b8b2f98d-d61d-4241-b104-057756aefbbb tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:22.930296 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-b8b2f98d-d61d-4241-b104-057756aefbbb tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:23.154132 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-b8b2f98d-d61d-4241-b104-057756aefbbb tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:23.161942 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b8b2f98d-d61d-4241-b104-057756aefbbb tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 200 len: 1682 microversion: 2.1 time: 0.247683 Sep 09 23:32:23.162530 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 522/1072] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:22 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 1682 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:23.713776 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-544e3328-f15c-47c0-976b-2f252f81d7fe req-28d30edb-4c83-4b49-b5d3-4854e2041abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07912acd-a498-4b7e-80ce-606d8970f528", "name": "network-vif-deleted", "tag": "867923d7-36c4-4fc7-abe9-56b6959094a8"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:32:23.723781 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-544e3328-f15c-47c0-976b-2f252f81d7fe req-28d30edb-4c83-4b49-b5d3-4854e2041abf service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:23.724259 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-544e3328-f15c-47c0-976b-2f252f81d7fe req-28d30edb-4c83-4b49-b5d3-4854e2041abf service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:23.724687 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-544e3328-f15c-47c0-976b-2f252f81d7fe req-28d30edb-4c83-4b49-b5d3-4854e2041abf service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:23.736749 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-544e3328-f15c-47c0-976b-2f252f81d7fe req-28d30edb-4c83-4b49-b5d3-4854e2041abf service nova] Creating event network-vif-deleted:867923d7-36c4-4fc7-abe9-56b6959094a8 for instance 07912acd-a498-4b7e-80ce-606d8970f528 on hv-cinder-85032 Sep 09 23:32:23.742061 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-544e3328-f15c-47c0-976b-2f252f81d7fe req-28d30edb-4c83-4b49-b5d3-4854e2041abf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032450 Sep 09 23:32:23.742885 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 551/1073] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:32:24.187806 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3143546b-9816-4b1d-87b1-ea6b2ee6ae9b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:24.188516 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3143546b-9816-4b1d-87b1-ea6b2ee6ae9b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:24.196433 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3143546b-9816-4b1d-87b1-ea6b2ee6ae9b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:24.196938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3143546b-9816-4b1d-87b1-ea6b2ee6ae9b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:24.197380 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3143546b-9816-4b1d-87b1-ea6b2ee6ae9b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:24.198079 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3143546b-9816-4b1d-87b1-ea6b2ee6ae9b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:24.198566 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3143546b-9816-4b1d-87b1-ea6b2ee6ae9b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:24.198994 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3143546b-9816-4b1d-87b1-ea6b2ee6ae9b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:24.232600 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3143546b-9816-4b1d-87b1-ea6b2ee6ae9b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:24.233094 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3143546b-9816-4b1d-87b1-ea6b2ee6ae9b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:24.233532 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3143546b-9816-4b1d-87b1-ea6b2ee6ae9b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:24.234562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.objects.instance [None req-3143546b-9816-4b1d-87b1-ea6b2ee6ae9b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lazy-loading 'fault' on Instance uuid 07912acd-a498-4b7e-80ce-606d8970f528 {{(pid=121058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:32:24.275813 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3143546b-9816-4b1d-87b1-ea6b2ee6ae9b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:24.283518 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3143546b-9816-4b1d-87b1-ea6b2ee6ae9b tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 200 len: 1331 microversion: 2.1 time: 0.099860 Sep 09 23:32:24.284098 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 523/1074] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:24 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:25.309518 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-700d8d80-9384-4cca-b0f5-9904009cac3d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:25.310131 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-700d8d80-9384-4cca-b0f5-9904009cac3d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:25.316590 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-700d8d80-9384-4cca-b0f5-9904009cac3d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:25.324701 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-700d8d80-9384-4cca-b0f5-9904009cac3d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:25.324701 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-700d8d80-9384-4cca-b0f5-9904009cac3d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:25.324701 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-700d8d80-9384-4cca-b0f5-9904009cac3d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:25.324701 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-700d8d80-9384-4cca-b0f5-9904009cac3d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:25.325116 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-700d8d80-9384-4cca-b0f5-9904009cac3d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:25.332995 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-700d8d80-9384-4cca-b0f5-9904009cac3d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] HTTP exception thrown: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-700d8d80-9384-4cca-b0f5-9904009cac3d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Request method failure captured: Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 HTTP/1.1 Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8woRMVyoU9aLaBHLfxWq3rhgSNfpDXsHrJ0JUVxxXk7N_vHMOu7IKDmy7Ln-hyMIN_NjduqULel4lJLROHRtQ-6Op9IQi2psaTOuqyihyzV19hZ7jrQEMS9G45jhSxfqzPTvA4Ts62X0j3XSTOZ7Ne8N5xbdyc_SaHiCOAAIt150ZA Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:32:25.334623 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:32:25.336206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d57c38134f1484d9b208de1b9d8e26e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:32:25.336206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:32:25.336206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:32:25.336206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:32:25.336206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:32:25.336206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:32:25.336206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:32:25.336206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 592da799f0c540d68a2cc6d54006467c Sep 09 23:32:25.336206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:32:25.336206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:32:25.336206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. Sep 09 23:32:25.336206 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '07912acd-a498-4b7e-80ce-606d8970f528'} Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:32:25.337051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. Sep 09 23:32:25.339136 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:32:25.340495 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-700d8d80-9384-4cca-b0f5-9904009cac3d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Returning 404 to user: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:32:25.340495 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-700d8d80-9384-4cca-b0f5-9904009cac3d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 404 len: 111 microversion: 2.1 time: 0.032038 Sep 09 23:32:25.340495 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 552/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:25 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:32:25.345629 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-b187c2b3-b268-4780-96ad-a05788cc7c12 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '.version_select at 0x7f908de4cdc0>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:25.450273 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-b187c2b3-b268-4780-96ad-a05788cc7c12 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446413714" status: 202 len: 0 microversion: 2.1 time: 0.108356 Sep 09 23:32:25.450896 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 524/1076] 10.222.0.20 () {58 vars in 1221 bytes} [Fri Sep 9 23:32:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446413714 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:32:26.177936 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fedf5a7c-83eb-40de-be03-ed3086db92f9 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Action: 'create', calling method: .version_select at 0x7f908dbca280>, body: {"keypair": {"name": "tempest-keypair-637442492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0ZPmx6SkJODMCD3PjRJsENwUpW4fJL2u5YI9z0gKSIbAqkAEgFYKzepYrbLHPa5b4buYbq7HlrqWbRWUBjH1ccOoJmMAG2D3Y4b2W+iac31GgUExNHdsEEfeuQT1Pvkg=="}} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:32:26.193329 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-fedf5a7c-83eb-40de-be03-ed3086db92f9 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'key_pairs'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:32:26.197784 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.quota [None req-fedf5a7c-83eb-40de-be03-ed3086db92f9 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for user 592da799f0c540d68a2cc6d54006467c and project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'key_pairs'} {{(pid=121059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:32:26.302216 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-fedf5a7c-83eb-40de-be03-ed3086db92f9 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128231 Sep 09 23:32:26.302970 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 553/1077] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 23:32:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:32:28.503101 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-729581879", "imageRef": "08de0c2e-d45c-4312-be00-41ca9e854ac5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a5627a6-2ca5-4346-988f-094c3aa681f1"}], "security_groups": [{"name": "tempest-securitygroup--1332873944"}], "key_name": "tempest-keypair-637442492", "user_data": "}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:32:28.605780 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.network.neutron [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] validate_networks() for [('9a5627a6-2ca5-4346-988f-094c3aa681f1', None, None, None, None, None)] {{(pid=121058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:32:29.032558 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Flavor limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:32:29.032918 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Image limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:32:29.033387 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Flavor pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:32:29.033791 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Image pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:32:29.034259 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:32:29.042996 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:29.043474 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:29.043903 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:29.044681 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:29.045125 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:29.045547 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:29.065547 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:32:29.069635 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Getting quotas for user 592da799f0c540d68a2cc6d54006467c and project 9d57c38134f1484d9b208de1b9d8e26e. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:32:29.081226 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Going to run 1 instances... {{(pid=121058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:32:29.083554 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08de0c2e-d45c-4312-be00-41ca9e854ac5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:32:29.216737 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3a34fffc-3cfc-4e33-a57f-3f05f1b25d82 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.718369 Sep 09 23:32:29.217379 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 525/1078] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:32:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:32:29.228921 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ab5d46da-8a7c-4c62-b4b7-e2fd1fdc9e69 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:29.230092 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ab5d46da-8a7c-4c62-b4b7-e2fd1fdc9e69 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:29.288532 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ab5d46da-8a7c-4c62-b4b7-e2fd1fdc9e69 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:29.296386 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ab5d46da-8a7c-4c62-b4b7-e2fd1fdc9e69 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1240 microversion: 2.1 time: 0.071811 Sep 09 23:32:29.296944 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 554/1079] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:29 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:30.320537 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-309fe0c5-6e1e-49e9-9e6a-7c5d0cee8376 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:30.321139 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-309fe0c5-6e1e-49e9-9e6a-7c5d0cee8376 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:30.327601 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-309fe0c5-6e1e-49e9-9e6a-7c5d0cee8376 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:30.328086 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-309fe0c5-6e1e-49e9-9e6a-7c5d0cee8376 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:30.330753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-309fe0c5-6e1e-49e9-9e6a-7c5d0cee8376 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:30.330753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-309fe0c5-6e1e-49e9-9e6a-7c5d0cee8376 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:30.330753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-309fe0c5-6e1e-49e9-9e6a-7c5d0cee8376 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:30.330753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-309fe0c5-6e1e-49e9-9e6a-7c5d0cee8376 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:30.394259 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-309fe0c5-6e1e-49e9-9e6a-7c5d0cee8376 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:30.402596 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-309fe0c5-6e1e-49e9-9e6a-7c5d0cee8376 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1236 microversion: 2.1 time: 0.086288 Sep 09 23:32:30.403088 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 526/1080] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:30 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1236 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:31.431258 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-c48a3727-10cb-4bbb-9605-e8afa50e3055 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:31.431866 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-c48a3727-10cb-4bbb-9605-e8afa50e3055 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:31.438718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c48a3727-10cb-4bbb-9605-e8afa50e3055 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:31.441601 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c48a3727-10cb-4bbb-9605-e8afa50e3055 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:31.441601 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c48a3727-10cb-4bbb-9605-e8afa50e3055 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:31.441601 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c48a3727-10cb-4bbb-9605-e8afa50e3055 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:31.441601 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c48a3727-10cb-4bbb-9605-e8afa50e3055 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:31.441984 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-c48a3727-10cb-4bbb-9605-e8afa50e3055 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:31.445363 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:32:31.507792 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-c48a3727-10cb-4bbb-9605-e8afa50e3055 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:31.516125 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-c48a3727-10cb-4bbb-9605-e8afa50e3055 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1300 microversion: 2.1 time: 0.088809 Sep 09 23:32:31.520412 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 555/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:31 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:32.539555 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-1b91c171-91ae-4f98-9933-3eca55a2487c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:32.540187 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-1b91c171-91ae-4f98-9933-3eca55a2487c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:32.547851 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b91c171-91ae-4f98-9933-3eca55a2487c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:32.548339 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b91c171-91ae-4f98-9933-3eca55a2487c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:32.548787 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b91c171-91ae-4f98-9933-3eca55a2487c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:32.549497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b91c171-91ae-4f98-9933-3eca55a2487c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:32.549963 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b91c171-91ae-4f98-9933-3eca55a2487c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:32.550439 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-1b91c171-91ae-4f98-9933-3eca55a2487c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:32.756448 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-1b91c171-91ae-4f98-9933-3eca55a2487c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:32.764316 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-1b91c171-91ae-4f98-9933-3eca55a2487c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1366 microversion: 2.1 time: 0.228611 Sep 09 23:32:32.764896 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 527/1082] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:32 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:33.034193 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-a6286738-d18d-4867-ac6b-695a2aab4b2c req-2d985aa3-4b3a-45e6-acd4-a1c336217087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e04e34f-7f05-432e-8e49-3896804abdfe", "tag": "be8c5eac-5252-41b5-9f83-be4c63d96454"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:32:33.039647 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:32:33.045315 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-a6286738-d18d-4867-ac6b-695a2aab4b2c req-2d985aa3-4b3a-45e6-acd4-a1c336217087 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:33.045799 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-a6286738-d18d-4867-ac6b-695a2aab4b2c req-2d985aa3-4b3a-45e6-acd4-a1c336217087 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:33.046916 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-a6286738-d18d-4867-ac6b-695a2aab4b2c req-2d985aa3-4b3a-45e6-acd4-a1c336217087 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:33.057223 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-a6286738-d18d-4867-ac6b-695a2aab4b2c req-2d985aa3-4b3a-45e6-acd4-a1c336217087 service nova] Creating event network-changed:be8c5eac-5252-41b5-9f83-be4c63d96454 for instance 3e04e34f-7f05-432e-8e49-3896804abdfe on hv-cinder-85032 Sep 09 23:32:33.062300 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-a6286738-d18d-4867-ac6b-695a2aab4b2c req-2d985aa3-4b3a-45e6-acd4-a1c336217087 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032653 Sep 09 23:32:33.062922 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 556/1083] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:32:33.787934 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ae9871db-63c7-42fd-8ca8-c622a451203d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:33.788561 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ae9871db-63c7-42fd-8ca8-c622a451203d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:33.795971 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ae9871db-63c7-42fd-8ca8-c622a451203d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:33.796449 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ae9871db-63c7-42fd-8ca8-c622a451203d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:33.796893 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ae9871db-63c7-42fd-8ca8-c622a451203d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:33.797594 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ae9871db-63c7-42fd-8ca8-c622a451203d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:33.798050 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ae9871db-63c7-42fd-8ca8-c622a451203d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:33.798516 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ae9871db-63c7-42fd-8ca8-c622a451203d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:34.021111 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ae9871db-63c7-42fd-8ca8-c622a451203d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:34.029597 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ae9871db-63c7-42fd-8ca8-c622a451203d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1366 microversion: 2.1 time: 0.245517 Sep 09 23:32:34.030209 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 528/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:33 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:35.055081 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-bfec9c6d-aa42-4985-b03d-7c234f8d6d65 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:35.055786 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-bfec9c6d-aa42-4985-b03d-7c234f8d6d65 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:35.063496 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bfec9c6d-aa42-4985-b03d-7c234f8d6d65 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:35.067233 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bfec9c6d-aa42-4985-b03d-7c234f8d6d65 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:35.067233 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bfec9c6d-aa42-4985-b03d-7c234f8d6d65 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:35.067233 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bfec9c6d-aa42-4985-b03d-7c234f8d6d65 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:35.067233 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bfec9c6d-aa42-4985-b03d-7c234f8d6d65 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:35.067653 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bfec9c6d-aa42-4985-b03d-7c234f8d6d65 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:35.198475 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-bfec9c6d-aa42-4985-b03d-7c234f8d6d65 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:35.206610 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-bfec9c6d-aa42-4985-b03d-7c234f8d6d65 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1366 microversion: 2.1 time: 0.156827 Sep 09 23:32:35.207172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 557/1085] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:35 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:36.230719 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-abba862c-95a5-405c-bb40-c72bc5bba0b0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:36.231404 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-abba862c-95a5-405c-bb40-c72bc5bba0b0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:36.237682 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-abba862c-95a5-405c-bb40-c72bc5bba0b0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:36.238159 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-abba862c-95a5-405c-bb40-c72bc5bba0b0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:36.238874 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-abba862c-95a5-405c-bb40-c72bc5bba0b0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:36.239558 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-abba862c-95a5-405c-bb40-c72bc5bba0b0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:36.240010 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-abba862c-95a5-405c-bb40-c72bc5bba0b0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:36.240433 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-abba862c-95a5-405c-bb40-c72bc5bba0b0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:36.372328 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-abba862c-95a5-405c-bb40-c72bc5bba0b0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:36.380246 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-abba862c-95a5-405c-bb40-c72bc5bba0b0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1366 microversion: 2.1 time: 0.154159 Sep 09 23:32:36.380855 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 529/1086] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:36 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:37.408925 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4cf74fb3-64af-4d03-b471-d8b9494c1c5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:37.409550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4cf74fb3-64af-4d03-b471-d8b9494c1c5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:37.417904 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4cf74fb3-64af-4d03-b471-d8b9494c1c5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:37.418429 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4cf74fb3-64af-4d03-b471-d8b9494c1c5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:37.418869 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4cf74fb3-64af-4d03-b471-d8b9494c1c5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:37.419591 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4cf74fb3-64af-4d03-b471-d8b9494c1c5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:37.420203 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4cf74fb3-64af-4d03-b471-d8b9494c1c5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:37.420691 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4cf74fb3-64af-4d03-b471-d8b9494c1c5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:37.557604 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4cf74fb3-64af-4d03-b471-d8b9494c1c5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:37.565315 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4cf74fb3-64af-4d03-b471-d8b9494c1c5e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1366 microversion: 2.1 time: 0.160337 Sep 09 23:32:37.565876 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 558/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:37 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:38.588493 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5f4cdcc7-e7f8-4789-acdc-b00092439c80 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:38.589102 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5f4cdcc7-e7f8-4789-acdc-b00092439c80 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:38.595461 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5f4cdcc7-e7f8-4789-acdc-b00092439c80 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:38.595940 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5f4cdcc7-e7f8-4789-acdc-b00092439c80 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:38.596384 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5f4cdcc7-e7f8-4789-acdc-b00092439c80 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:38.597066 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5f4cdcc7-e7f8-4789-acdc-b00092439c80 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:38.597517 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5f4cdcc7-e7f8-4789-acdc-b00092439c80 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:38.597941 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5f4cdcc7-e7f8-4789-acdc-b00092439c80 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:38.724259 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-5f4cdcc7-e7f8-4789-acdc-b00092439c80 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:38.732937 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5f4cdcc7-e7f8-4789-acdc-b00092439c80 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1366 microversion: 2.1 time: 0.148292 Sep 09 23:32:38.733586 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 530/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:38 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:39.015172 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-9024d496-59a0-4222-821a-3dad034847dc req-38cbcd35-6f97-45d4-ac52-89f57868ed01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e04e34f-7f05-432e-8e49-3896804abdfe", "name": "network-vif-plugged", "status": "completed", "tag": "be8c5eac-5252-41b5-9f83-be4c63d96454"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:32:39.025095 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-9024d496-59a0-4222-821a-3dad034847dc req-38cbcd35-6f97-45d4-ac52-89f57868ed01 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:39.025573 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-9024d496-59a0-4222-821a-3dad034847dc req-38cbcd35-6f97-45d4-ac52-89f57868ed01 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:39.026029 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-9024d496-59a0-4222-821a-3dad034847dc req-38cbcd35-6f97-45d4-ac52-89f57868ed01 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:39.037110 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-9024d496-59a0-4222-821a-3dad034847dc req-38cbcd35-6f97-45d4-ac52-89f57868ed01 service nova] Creating event network-vif-plugged:be8c5eac-5252-41b5-9f83-be4c63d96454 for instance 3e04e34f-7f05-432e-8e49-3896804abdfe on hv-cinder-85032 Sep 09 23:32:39.042299 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-9024d496-59a0-4222-821a-3dad034847dc req-38cbcd35-6f97-45d4-ac52-89f57868ed01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030916 Sep 09 23:32:39.043450 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 559/1089] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:32:39.756453 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4c9775a4-1d81-40ce-97e8-c5592b5899f2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:39.757070 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4c9775a4-1d81-40ce-97e8-c5592b5899f2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:39.759068 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=2 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:32:39.759742 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=6 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:32:39.770612 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c9775a4-1d81-40ce-97e8-c5592b5899f2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:39.774022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c9775a4-1d81-40ce-97e8-c5592b5899f2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:39.774022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c9775a4-1d81-40ce-97e8-c5592b5899f2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:39.774022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c9775a4-1d81-40ce-97e8-c5592b5899f2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:39.774022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c9775a4-1d81-40ce-97e8-c5592b5899f2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:39.774460 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4c9775a4-1d81-40ce-97e8-c5592b5899f2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:39.908070 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4c9775a4-1d81-40ce-97e8-c5592b5899f2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:39.915542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4c9775a4-1d81-40ce-97e8-c5592b5899f2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1366 microversion: 2.1 time: 0.163010 Sep 09 23:32:39.916109 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 531/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:39 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:40.935074 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=6 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:32:40.939509 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ef6da223-947b-42b2-9ac9-86c605588898 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:40.943011 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ef6da223-947b-42b2-9ac9-86c605588898 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:40.946197 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef6da223-947b-42b2-9ac9-86c605588898 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:40.946711 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef6da223-947b-42b2-9ac9-86c605588898 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:40.947145 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef6da223-947b-42b2-9ac9-86c605588898 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:40.947824 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef6da223-947b-42b2-9ac9-86c605588898 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:40.948274 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef6da223-947b-42b2-9ac9-86c605588898 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:40.948722 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ef6da223-947b-42b2-9ac9-86c605588898 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:41.084851 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ef6da223-947b-42b2-9ac9-86c605588898 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:41.093141 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ef6da223-947b-42b2-9ac9-86c605588898 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1366 microversion: 2.1 time: 0.159186 Sep 09 23:32:41.093706 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 560/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:40 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:42.116285 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a7ad9487-f48a-425a-8b9c-0a594ac7de70 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:42.116901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a7ad9487-f48a-425a-8b9c-0a594ac7de70 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:42.124022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a7ad9487-f48a-425a-8b9c-0a594ac7de70 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:42.124509 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a7ad9487-f48a-425a-8b9c-0a594ac7de70 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:42.125176 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a7ad9487-f48a-425a-8b9c-0a594ac7de70 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:42.125881 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a7ad9487-f48a-425a-8b9c-0a594ac7de70 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:42.126357 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a7ad9487-f48a-425a-8b9c-0a594ac7de70 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:42.126855 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a7ad9487-f48a-425a-8b9c-0a594ac7de70 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:42.257229 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-a7ad9487-f48a-425a-8b9c-0a594ac7de70 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:32:42.265007 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a7ad9487-f48a-425a-8b9c-0a594ac7de70 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1556 microversion: 2.1 time: 0.152882 Sep 09 23:32:42.265575 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 532/1092] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:32:42 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:32:42.287872 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-2661cace-7981-4df6-af78-4924e4372ea4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:32:42.288379 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-2661cace-7981-4df6-af78-4924e4372ea4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:32:42.295575 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2661cace-7981-4df6-af78-4924e4372ea4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:42.296051 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2661cace-7981-4df6-af78-4924e4372ea4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:42.296615 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2661cace-7981-4df6-af78-4924e4372ea4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:42.297347 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2661cace-7981-4df6-af78-4924e4372ea4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:42.297801 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2661cace-7981-4df6-af78-4924e4372ea4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:42.298272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-2661cace-7981-4df6-af78-4924e4372ea4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:42.374845 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-2661cace-7981-4df6-af78-4924e4372ea4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090776 Sep 09 23:32:42.375437 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 561/1093] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 23:32:42 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:32:43.346626 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-9b77e691-575d-4923-84da-238563c016fc req-03c09627-393d-4b6e-bd65-ec78fa635dbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e04e34f-7f05-432e-8e49-3896804abdfe", "tag": "be8c5eac-5252-41b5-9f83-be4c63d96454"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:32:43.356798 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-9b77e691-575d-4923-84da-238563c016fc req-03c09627-393d-4b6e-bd65-ec78fa635dbb service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:32:43.357288 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-9b77e691-575d-4923-84da-238563c016fc req-03c09627-393d-4b6e-bd65-ec78fa635dbb service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:32:43.357723 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-9b77e691-575d-4923-84da-238563c016fc req-03c09627-393d-4b6e-bd65-ec78fa635dbb service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:32:43.369985 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-9b77e691-575d-4923-84da-238563c016fc req-03c09627-393d-4b6e-bd65-ec78fa635dbb service nova] Creating event network-changed:be8c5eac-5252-41b5-9f83-be4c63d96454 for instance 3e04e34f-7f05-432e-8e49-3896804abdfe on hv-cinder-85032 Sep 09 23:32:43.377949 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-9b77e691-575d-4923-84da-238563c016fc req-03c09627-393d-4b6e-bd65-ec78fa635dbb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032902 Sep 09 23:32:43.377949 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 533/1094] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:33:21.393587 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=11 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:33:21.394367 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=31 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:33:21.398919 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-523207da-90a8-44ad-bc92-d9233587dfa0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:21.399410 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-523207da-90a8-44ad-bc92-d9233587dfa0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:21.405392 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-523207da-90a8-44ad-bc92-d9233587dfa0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:21.408586 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-523207da-90a8-44ad-bc92-d9233587dfa0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:21.408586 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-523207da-90a8-44ad-bc92-d9233587dfa0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:21.408586 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-523207da-90a8-44ad-bc92-d9233587dfa0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:21.408586 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-523207da-90a8-44ad-bc92-d9233587dfa0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:21.408965 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-523207da-90a8-44ad-bc92-d9233587dfa0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:21.432371 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-523207da-90a8-44ad-bc92-d9233587dfa0 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe/ips" status: 200 len: 150 microversion: 2.1 time: 0.040224 Sep 09 23:33:21.432951 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 562/1095] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 23:33:21 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:33:23.041471 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:33:23.042220 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:33:23.046832 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a636596c-70de-4353-82fa-2d80310b1a8c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "922d99dd-c6da-43f3-bcfb-f45b77dc5295"}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:33:23.052340 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a636596c-70de-4353-82fa-2d80310b1a8c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:23.056225 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a636596c-70de-4353-82fa-2d80310b1a8c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:23.056701 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a636596c-70de-4353-82fa-2d80310b1a8c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:23.057130 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a636596c-70de-4353-82fa-2d80310b1a8c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:23.057845 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a636596c-70de-4353-82fa-2d80310b1a8c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:23.058302 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a636596c-70de-4353-82fa-2d80310b1a8c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:23.058764 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a636596c-70de-4353-82fa-2d80310b1a8c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:23.790534 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a636596c-70de-4353-82fa-2d80310b1a8c tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "POST /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750467 Sep 09 23:33:23.791243 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 534/1096] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 23:33:23 2022] POST /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe/os-volume_attachments => generated 194 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:33:31.439034 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-7bd5c743-8192-4b0a-af5a-deed2aace57e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:31.439512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-7bd5c743-8192-4b0a-af5a-deed2aace57e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:31.442088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=2 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:33:31.447240 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7bd5c743-8192-4b0a-af5a-deed2aace57e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:31.451921 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7bd5c743-8192-4b0a-af5a-deed2aace57e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:31.451921 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7bd5c743-8192-4b0a-af5a-deed2aace57e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:31.451921 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7bd5c743-8192-4b0a-af5a-deed2aace57e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:31.451921 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7bd5c743-8192-4b0a-af5a-deed2aace57e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:31.452281 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-7bd5c743-8192-4b0a-af5a-deed2aace57e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:31.533549 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-7bd5c743-8192-4b0a-af5a-deed2aace57e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lazy-loading 'services' on Instance uuid 3e04e34f-7f05-432e-8e49-3896804abdfe {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:33:31.710314 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-7bd5c743-8192-4b0a-af5a-deed2aace57e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe/os-volume_attachments/922d99dd-c6da-43f3-bcfb-f45b77dc5295" status: 202 len: 0 microversion: 2.1 time: 0.274988 Sep 09 23:33:31.710938 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 563/1097] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 23:33:31 2022] DELETE /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe/os-volume_attachments/922d99dd-c6da-43f3-bcfb-f45b77dc5295 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:33:31.723087 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c9f5d750-d910-4776-bd95-952b51af5696 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:31.725378 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c9f5d750-d910-4776-bd95-952b51af5696 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:31.732507 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c9f5d750-d910-4776-bd95-952b51af5696 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:31.732997 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c9f5d750-d910-4776-bd95-952b51af5696 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:31.733438 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c9f5d750-d910-4776-bd95-952b51af5696 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:31.734143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c9f5d750-d910-4776-bd95-952b51af5696 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:31.734682 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c9f5d750-d910-4776-bd95-952b51af5696 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:31.740116 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c9f5d750-d910-4776-bd95-952b51af5696 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:31.765322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c9f5d750-d910-4776-bd95-952b51af5696 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049577 Sep 09 23:33:31.766101 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 535/1098] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:33:31 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:33:32.778911 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-60b99de7-5d4d-4d79-8d4c-986bbb7842e4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:32.781341 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-60b99de7-5d4d-4d79-8d4c-986bbb7842e4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:32.791430 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-60b99de7-5d4d-4d79-8d4c-986bbb7842e4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:32.791921 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-60b99de7-5d4d-4d79-8d4c-986bbb7842e4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:32.792366 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-60b99de7-5d4d-4d79-8d4c-986bbb7842e4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:32.793194 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-60b99de7-5d4d-4d79-8d4c-986bbb7842e4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:32.796283 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-60b99de7-5d4d-4d79-8d4c-986bbb7842e4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:32.796733 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-60b99de7-5d4d-4d79-8d4c-986bbb7842e4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:32.833259 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-60b99de7-5d4d-4d79-8d4c-986bbb7842e4 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059742 Sep 09 23:33:32.833827 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 564/1099] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 23:33:32 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 23:33:32.897997 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9ae337fc-618c-42a1-90ae-886e864d4e81 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:32.898559 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9ae337fc-618c-42a1-90ae-886e864d4e81 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:32.905100 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ae337fc-618c-42a1-90ae-886e864d4e81 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:32.905586 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ae337fc-618c-42a1-90ae-886e864d4e81 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:32.906028 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ae337fc-618c-42a1-90ae-886e864d4e81 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:32.906756 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ae337fc-618c-42a1-90ae-886e864d4e81 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:32.907225 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ae337fc-618c-42a1-90ae-886e864d4e81 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:32.907657 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ae337fc-618c-42a1-90ae-886e864d4e81 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:32.933669 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9ae337fc-618c-42a1-90ae-886e864d4e81 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Going to try to terminate instance {{(pid=121058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:33:33.202407 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9ae337fc-618c-42a1-90ae-886e864d4e81 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 204 len: 0 microversion: 2.1 time: 0.307796 Sep 09 23:33:33.202939 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 536/1100] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:33:32 2022] DELETE /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:33:33.211063 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-b0fbb232-8fc4-4026-99bc-4c4f381fe378 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:33.211733 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-b0fbb232-8fc4-4026-99bc-4c4f381fe378 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:33.217777 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b0fbb232-8fc4-4026-99bc-4c4f381fe378 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:33.218265 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b0fbb232-8fc4-4026-99bc-4c4f381fe378 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:33.218736 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b0fbb232-8fc4-4026-99bc-4c4f381fe378 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:33.219429 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b0fbb232-8fc4-4026-99bc-4c4f381fe378 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:33.219884 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b0fbb232-8fc4-4026-99bc-4c4f381fe378 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:33.220308 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-b0fbb232-8fc4-4026-99bc-4c4f381fe378 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:33.351721 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-b0fbb232-8fc4-4026-99bc-4c4f381fe378 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:33.360074 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-b0fbb232-8fc4-4026-99bc-4c4f381fe378 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1681 microversion: 2.1 time: 0.152843 Sep 09 23:33:33.360634 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 565/1101] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:33 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:34.384418 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9c73c133-384e-4c1d-9d84-657bb92a2e54 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:34.385154 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9c73c133-384e-4c1d-9d84-657bb92a2e54 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:34.391683 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9c73c133-384e-4c1d-9d84-657bb92a2e54 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:34.392169 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9c73c133-384e-4c1d-9d84-657bb92a2e54 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:34.392597 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9c73c133-384e-4c1d-9d84-657bb92a2e54 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:34.393283 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9c73c133-384e-4c1d-9d84-657bb92a2e54 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:34.393753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9c73c133-384e-4c1d-9d84-657bb92a2e54 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:34.394173 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9c73c133-384e-4c1d-9d84-657bb92a2e54 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:34.527320 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-9c73c133-384e-4c1d-9d84-657bb92a2e54 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:34.534928 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9c73c133-384e-4c1d-9d84-657bb92a2e54 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1681 microversion: 2.1 time: 0.155459 Sep 09 23:33:34.535503 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 537/1102] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:34 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:35.558545 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fefbc22b-3253-4b1f-b3b1-c0ce0cbed711 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:35.559112 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-fefbc22b-3253-4b1f-b3b1-c0ce0cbed711 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:35.565512 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fefbc22b-3253-4b1f-b3b1-c0ce0cbed711 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:35.566019 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fefbc22b-3253-4b1f-b3b1-c0ce0cbed711 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:35.566469 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fefbc22b-3253-4b1f-b3b1-c0ce0cbed711 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:35.567168 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fefbc22b-3253-4b1f-b3b1-c0ce0cbed711 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:35.567625 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fefbc22b-3253-4b1f-b3b1-c0ce0cbed711 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:35.568053 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fefbc22b-3253-4b1f-b3b1-c0ce0cbed711 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:35.636827 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fefbc22b-3253-4b1f-b3b1-c0ce0cbed711 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:35.644983 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-fefbc22b-3253-4b1f-b3b1-c0ce0cbed711 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1613 microversion: 2.1 time: 0.090738 Sep 09 23:33:35.645553 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 566/1103] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:35 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1613 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:35.877460 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-187b0d87-c68f-44b0-99eb-f57cec31c826 req-89d849df-6e9d-47ca-bf0c-4f9a3dc2943f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e04e34f-7f05-432e-8e49-3896804abdfe", "name": "network-vif-deleted", "tag": "be8c5eac-5252-41b5-9f83-be4c63d96454"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:33:35.888632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-187b0d87-c68f-44b0-99eb-f57cec31c826 req-89d849df-6e9d-47ca-bf0c-4f9a3dc2943f service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:35.889123 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-187b0d87-c68f-44b0-99eb-f57cec31c826 req-89d849df-6e9d-47ca-bf0c-4f9a3dc2943f service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:35.889618 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-187b0d87-c68f-44b0-99eb-f57cec31c826 req-89d849df-6e9d-47ca-bf0c-4f9a3dc2943f service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:35.902457 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-187b0d87-c68f-44b0-99eb-f57cec31c826 req-89d849df-6e9d-47ca-bf0c-4f9a3dc2943f service nova] Creating event network-vif-deleted:be8c5eac-5252-41b5-9f83-be4c63d96454 for instance 3e04e34f-7f05-432e-8e49-3896804abdfe on hv-cinder-85032 Sep 09 23:33:35.907543 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-187b0d87-c68f-44b0-99eb-f57cec31c826 req-89d849df-6e9d-47ca-bf0c-4f9a3dc2943f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034195 Sep 09 23:33:35.908145 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 538/1104] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:33:36.668885 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-a0f1f71d-dbaa-4c21-943e-91de875d0398 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:36.669498 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-a0f1f71d-dbaa-4c21-943e-91de875d0398 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:36.676066 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a0f1f71d-dbaa-4c21-943e-91de875d0398 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:36.676554 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a0f1f71d-dbaa-4c21-943e-91de875d0398 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:36.676993 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a0f1f71d-dbaa-4c21-943e-91de875d0398 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:36.677723 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a0f1f71d-dbaa-4c21-943e-91de875d0398 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:36.678181 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a0f1f71d-dbaa-4c21-943e-91de875d0398 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:36.678709 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-a0f1f71d-dbaa-4c21-943e-91de875d0398 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:36.741910 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-a0f1f71d-dbaa-4c21-943e-91de875d0398 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:36.749845 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-a0f1f71d-dbaa-4c21-943e-91de875d0398 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1613 microversion: 2.1 time: 0.085024 Sep 09 23:33:36.750422 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 567/1105] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:36 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:37.775850 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-0524b467-89ea-4c2a-a781-d9d341bd8182 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:37.776484 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-0524b467-89ea-4c2a-a781-d9d341bd8182 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:37.784638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0524b467-89ea-4c2a-a781-d9d341bd8182 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:37.785144 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0524b467-89ea-4c2a-a781-d9d341bd8182 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:37.785616 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0524b467-89ea-4c2a-a781-d9d341bd8182 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:37.786426 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0524b467-89ea-4c2a-a781-d9d341bd8182 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:37.786889 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0524b467-89ea-4c2a-a781-d9d341bd8182 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:37.787387 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-0524b467-89ea-4c2a-a781-d9d341bd8182 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:37.865037 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-0524b467-89ea-4c2a-a781-d9d341bd8182 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:37.876327 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-0524b467-89ea-4c2a-a781-d9d341bd8182 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1325 microversion: 2.1 time: 0.105935 Sep 09 23:33:37.877291 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 539/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:37 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1325 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:38.905295 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-d0c3f641-e049-4ecf-9971-3755554213ef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:38.905908 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-d0c3f641-e049-4ecf-9971-3755554213ef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:38.912469 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d0c3f641-e049-4ecf-9971-3755554213ef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:38.912986 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d0c3f641-e049-4ecf-9971-3755554213ef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:38.913424 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d0c3f641-e049-4ecf-9971-3755554213ef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:38.914260 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d0c3f641-e049-4ecf-9971-3755554213ef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:38.915440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d0c3f641-e049-4ecf-9971-3755554213ef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:38.915873 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d0c3f641-e049-4ecf-9971-3755554213ef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:38.947811 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d0c3f641-e049-4ecf-9971-3755554213ef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:38.948291 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d0c3f641-e049-4ecf-9971-3755554213ef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:38.948728 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-d0c3f641-e049-4ecf-9971-3755554213ef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:38.949178 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-d0c3f641-e049-4ecf-9971-3755554213ef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lazy-loading 'fault' on Instance uuid 3e04e34f-7f05-432e-8e49-3896804abdfe {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:33:38.989184 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-d0c3f641-e049-4ecf-9971-3755554213ef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592da799f0c540d68a2cc6d54006467c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d57c38134f1484d9b208de1b9d8e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:38.997923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-d0c3f641-e049-4ecf-9971-3755554213ef tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 200 len: 1330 microversion: 2.1 time: 0.097106 Sep 09 23:33:38.998526 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 568/1107] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:38 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:40.020841 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-cc572a28-94eb-4401-bca8-212d3991f58d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:40.021538 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-cc572a28-94eb-4401-bca8-212d3991f58d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:40.028699 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cc572a28-94eb-4401-bca8-212d3991f58d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:40.029416 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cc572a28-94eb-4401-bca8-212d3991f58d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:40.029874 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cc572a28-94eb-4401-bca8-212d3991f58d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:40.030593 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cc572a28-94eb-4401-bca8-212d3991f58d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:40.031050 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cc572a28-94eb-4401-bca8-212d3991f58d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:40.031479 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-cc572a28-94eb-4401-bca8-212d3991f58d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:40.045763 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-cc572a28-94eb-4401-bca8-212d3991f58d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] HTTP exception thrown: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-cc572a28-94eb-4401-bca8-212d3991f58d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Request method failure captured: Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe HTTP/1.1 Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8woRMVyoU9aLaBHLfxWq3rhgSNfpDXsHrJ0JUVxxXk7N_vHMOu7IKDmy7Ln-hyMIN_NjduqULel4lJLROHRtQ-6Op9IQi2psaTOuqyihyzV19hZ7jrQEMS9G45jhSxfqzPTvA4Ts62X0j3XSTOZ7Ne8N5xbdyc_SaHiCOAAIt150ZA Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:33:40.047445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:33:40.048938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d57c38134f1484d9b208de1b9d8e26e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:33:40.048938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:40.048938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:40.048938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:40.048938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:40.048938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:33:40.048938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:33:40.048938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 592da799f0c540d68a2cc6d54006467c Sep 09 23:33:40.048938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:40.048938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:33:40.048938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. Sep 09 23:33:40.048938 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '3e04e34f-7f05-432e-8e49-3896804abdfe'} Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:33:40.049857 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. Sep 09 23:33:40.051240 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:40.052454 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-cc572a28-94eb-4401-bca8-212d3991f58d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Returning 404 to user: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:33:40.052454 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-cc572a28-94eb-4401-bca8-212d3991f58d tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 404 len: 111 microversion: 2.1 time: 0.031776 Sep 09 23:33:40.052736 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 540/1108] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:40 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:33:40.058457 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-349e2b38-28ee-4aa3-b993-b450098657e5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '.version_select at 0x7f908dc34700>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:40.124100 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-349e2b38-28ee-4aa3-b993-b450098657e5 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-637442492" status: 202 len: 0 microversion: 2.1 time: 0.070182 Sep 09 23:33:40.124679 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 569/1109] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Sep 9 23:33:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-637442492 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:33:42.231301 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5fb69131-50a4-427c-9bc1-955aec9ec8ec tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:42.231834 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-5fb69131-50a4-427c-9bc1-955aec9ec8ec tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:42.238247 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5fb69131-50a4-427c-9bc1-955aec9ec8ec tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:42.238769 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5fb69131-50a4-427c-9bc1-955aec9ec8ec tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:42.239221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5fb69131-50a4-427c-9bc1-955aec9ec8ec tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:42.240177 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5fb69131-50a4-427c-9bc1-955aec9ec8ec tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:42.240639 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5fb69131-50a4-427c-9bc1-955aec9ec8ec tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:42.241064 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-5fb69131-50a4-427c-9bc1-955aec9ec8ec tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:42.254821 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-5fb69131-50a4-427c-9bc1-955aec9ec8ec tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] HTTP exception thrown: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5fb69131-50a4-427c-9bc1-955aec9ec8ec tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Request method failure captured: Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: DELETE /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe HTTP/1.1 Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8woRMVyoU9aLaBHLfxWq3rhgSNfpDXsHrJ0JUVxxXk7N_vHMOu7IKDmy7Ln-hyMIN_NjduqULel4lJLROHRtQ-6Op9IQi2psaTOuqyihyzV19hZ7jrQEMS9G45jhSxfqzPTvA4Ts62X0j3XSTOZ7Ne8N5xbdyc_SaHiCOAAIt150ZA Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:33:42.256374 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:33:42.258833 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d57c38134f1484d9b208de1b9d8e26e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:33:42.258833 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:42.258833 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:42.258833 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:42.258833 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:42.258833 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:33:42.258833 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:33:42.258833 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 592da799f0c540d68a2cc6d54006467c Sep 09 23:33:42.258833 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:42.258833 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:33:42.258833 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. Sep 09 23:33:42.258833 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '3e04e34f-7f05-432e-8e49-3896804abdfe'} Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:33:42.259982 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. Sep 09 23:33:42.261562 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:42.263340 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-5fb69131-50a4-427c-9bc1-955aec9ec8ec tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Returning 404 to user: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:33:42.263340 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-5fb69131-50a4-427c-9bc1-955aec9ec8ec tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 404 len: 111 microversion: 2.1 time: 0.030368 Sep 09 23:33:42.263340 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 541/1110] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:33:42 2022] DELETE /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:33:42.268071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-879eac69-0b63-4fb2-b370-c5a250b1c0b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:42.268686 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-879eac69-0b63-4fb2-b370-c5a250b1c0b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 3e04e34f-7f05-432e-8e49-3896804abdfe] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:42.275790 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-879eac69-0b63-4fb2-b370-c5a250b1c0b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:42.276268 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-879eac69-0b63-4fb2-b370-c5a250b1c0b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:42.276707 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-879eac69-0b63-4fb2-b370-c5a250b1c0b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:42.277392 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-879eac69-0b63-4fb2-b370-c5a250b1c0b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:42.277842 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-879eac69-0b63-4fb2-b370-c5a250b1c0b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:42.278264 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-879eac69-0b63-4fb2-b370-c5a250b1c0b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:42.292410 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-879eac69-0b63-4fb2-b370-c5a250b1c0b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] HTTP exception thrown: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-879eac69-0b63-4fb2-b370-c5a250b1c0b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Request method failure captured: Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe HTTP/1.1 Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8woRMVyoU9aLaBHLfxWq3rhgSNfpDXsHrJ0JUVxxXk7N_vHMOu7IKDmy7Ln-hyMIN_NjduqULel4lJLROHRtQ-6Op9IQi2psaTOuqyihyzV19hZ7jrQEMS9G45jhSxfqzPTvA4Ts62X0j3XSTOZ7Ne8N5xbdyc_SaHiCOAAIt150ZA Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:33:42.294064 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:33:42.295763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d57c38134f1484d9b208de1b9d8e26e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:33:42.295763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:42.295763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:42.295763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:42.295763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:42.295763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:33:42.295763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:33:42.295763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 592da799f0c540d68a2cc6d54006467c Sep 09 23:33:42.295763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:42.295763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:33:42.295763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. Sep 09 23:33:42.295763 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '3e04e34f-7f05-432e-8e49-3896804abdfe'} Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:33:42.296718 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. Sep 09 23:33:42.298214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:42.299636 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-879eac69-0b63-4fb2-b370-c5a250b1c0b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Returning 404 to user: Instance 3e04e34f-7f05-432e-8e49-3896804abdfe could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:33:42.299636 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-879eac69-0b63-4fb2-b370-c5a250b1c0b2 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe" status: 404 len: 111 microversion: 2.1 time: 0.032007 Sep 09 23:33:42.299636 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 570/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:42 2022] GET /compute/v2.1/servers/3e04e34f-7f05-432e-8e49-3896804abdfe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:33:43.333520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1239158990", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1647096225", "security_groups": [{"name": "tempest-secgroup-smoke-1193112495"}], "block_device_mapping_v2": [{"uuid": "963340f9-b164-49b0-9f9c-501b63a2b033", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7fd7062d-e427-4fda-80b7-f6a7278968d0"}]}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:33:43.451758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.network.neutron [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] validate_networks() for [('7fd7062d-e427-4fda-80b7-f6a7278968d0', None, None, None, None, None)] {{(pid=121058) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 23:33:43.623229 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-599782a0-702d-495d-a9f9-36773aa9695e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:43.623789 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-599782a0-702d-495d-a9f9-36773aa9695e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:43.630575 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-599782a0-702d-495d-a9f9-36773aa9695e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:43.631066 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-599782a0-702d-495d-a9f9-36773aa9695e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:43.631504 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-599782a0-702d-495d-a9f9-36773aa9695e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:43.632214 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-599782a0-702d-495d-a9f9-36773aa9695e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:43.632669 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-599782a0-702d-495d-a9f9-36773aa9695e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:43.633094 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-599782a0-702d-495d-a9f9-36773aa9695e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:43.648197 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-599782a0-702d-495d-a9f9-36773aa9695e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] HTTP exception thrown: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-599782a0-702d-495d-a9f9-36773aa9695e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Request method failure captured: Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: DELETE /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 HTTP/1.1 Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8woRMVyoU9aLaBHLfxWq3rhgSNfpDXsHrJ0JUVxxXk7N_vHMOu7IKDmy7Ln-hyMIN_NjduqULel4lJLROHRtQ-6Op9IQi2psaTOuqyihyzV19hZ7jrQEMS9G45jhSxfqzPTvA4Ts62X0j3XSTOZ7Ne8N5xbdyc_SaHiCOAAIt150ZA Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:33:43.650273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:33:43.651759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d57c38134f1484d9b208de1b9d8e26e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:33:43.651759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:43.651759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:43.651759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:43.651759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:43.651759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:33:43.651759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:33:43.651759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 592da799f0c540d68a2cc6d54006467c Sep 09 23:33:43.651759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:43.651759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:33:43.651759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. Sep 09 23:33:43.651759 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '07912acd-a498-4b7e-80ce-606d8970f528'} Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:33:43.652742 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. Sep 09 23:33:43.654158 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.656096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-599782a0-702d-495d-a9f9-36773aa9695e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Returning 404 to user: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:33:43.656096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-599782a0-702d-495d-a9f9-36773aa9695e tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "DELETE /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 404 len: 111 microversion: 2.1 time: 0.033670 Sep 09 23:33:43.656096 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 571/1112] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:33:43 2022] DELETE /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:33:43.661414 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4c9c2a0e-29e6-4871-b86f-c1c012d04d21 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:43.662228 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4c9c2a0e-29e6-4871-b86f-c1c012d04d21 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 07912acd-a498-4b7e-80ce-606d8970f528] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:43.669398 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c9c2a0e-29e6-4871-b86f-c1c012d04d21 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:43.669883 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c9c2a0e-29e6-4871-b86f-c1c012d04d21 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:43.670320 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c9c2a0e-29e6-4871-b86f-c1c012d04d21 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:43.671057 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c9c2a0e-29e6-4871-b86f-c1c012d04d21 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:43.671511 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c9c2a0e-29e6-4871-b86f-c1c012d04d21 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:43.671935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4c9c2a0e-29e6-4871-b86f-c1c012d04d21 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:43.689077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-4c9c2a0e-29e6-4871-b86f-c1c012d04d21 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] HTTP exception thrown: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4c9c2a0e-29e6-4871-b86f-c1c012d04d21 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Request method failure captured: Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 HTTP/1.1 Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8woRMVyoU9aLaBHLfxWq3rhgSNfpDXsHrJ0JUVxxXk7N_vHMOu7IKDmy7Ln-hyMIN_NjduqULel4lJLROHRtQ-6Op9IQi2psaTOuqyihyzV19hZ7jrQEMS9G45jhSxfqzPTvA4Ts62X0j3XSTOZ7Ne8N5xbdyc_SaHiCOAAIt150ZA Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:33:43.690814 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:33:43.692319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d57c38134f1484d9b208de1b9d8e26e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:33:43.692319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:43.692319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:43.692319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:43.692319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:43.692319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:33:43.692319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:33:43.692319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 592da799f0c540d68a2cc6d54006467c Sep 09 23:33:43.692319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:43.692319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:33:43.692319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. Sep 09 23:33:43.692319 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '07912acd-a498-4b7e-80ce-606d8970f528'} Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:33:43.693071 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. Sep 09 23:33:43.694593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.696209 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4c9c2a0e-29e6-4871-b86f-c1c012d04d21 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Returning 404 to user: Instance 07912acd-a498-4b7e-80ce-606d8970f528 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:33:43.696209 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4c9c2a0e-29e6-4871-b86f-c1c012d04d21 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528" status: 404 len: 111 microversion: 2.1 time: 0.034722 Sep 09 23:33:43.696209 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 572/1113] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:43 2022] GET /compute/v2.1/servers/07912acd-a498-4b7e-80ce-606d8970f528 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:33:43.701367 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f6b036d2-838d-4357-9e8f-b64f2e827dfa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:43.701988 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-f6b036d2-838d-4357-9e8f-b64f2e827dfa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:43.708056 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f6b036d2-838d-4357-9e8f-b64f2e827dfa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:43.708533 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f6b036d2-838d-4357-9e8f-b64f2e827dfa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:43.709128 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f6b036d2-838d-4357-9e8f-b64f2e827dfa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:43.709827 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f6b036d2-838d-4357-9e8f-b64f2e827dfa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:43.710281 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f6b036d2-838d-4357-9e8f-b64f2e827dfa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:43.710738 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-f6b036d2-838d-4357-9e8f-b64f2e827dfa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:43.725020 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-f6b036d2-838d-4357-9e8f-b64f2e827dfa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] HTTP exception thrown: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f6b036d2-838d-4357-9e8f-b64f2e827dfa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Request method failure captured: Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: DELETE /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 HTTP/1.1 Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8woRMVyoU9aLaBHLfxWq3rhgSNfpDXsHrJ0JUVxxXk7N_vHMOu7IKDmy7Ln-hyMIN_NjduqULel4lJLROHRtQ-6Op9IQi2psaTOuqyihyzV19hZ7jrQEMS9G45jhSxfqzPTvA4Ts62X0j3XSTOZ7Ne8N5xbdyc_SaHiCOAAIt150ZA Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:33:43.726619 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:33:43.728632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d57c38134f1484d9b208de1b9d8e26e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:33:43.728632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:43.728632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:43.728632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:43.728632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:43.728632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:33:43.728632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:33:43.728632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 592da799f0c540d68a2cc6d54006467c Sep 09 23:33:43.728632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:43.728632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:33:43.728632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. Sep 09 23:33:43.728632 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '0af84898-4d31-4109-ab87-199f3b65c034'} Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:33:43.729440 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. Sep 09 23:33:43.730771 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.732055 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f6b036d2-838d-4357-9e8f-b64f2e827dfa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Returning 404 to user: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:33:43.732055 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f6b036d2-838d-4357-9e8f-b64f2e827dfa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 404 len: 111 microversion: 2.1 time: 0.030617 Sep 09 23:33:43.732055 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 573/1114] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:33:43 2022] DELETE /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:33:43.737233 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3cca9b7d-80ec-40be-bfe2-1417b6978d93 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:43.737840 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3cca9b7d-80ec-40be-bfe2-1417b6978d93 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 0af84898-4d31-4109-ab87-199f3b65c034] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:43.744244 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cca9b7d-80ec-40be-bfe2-1417b6978d93 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:43.744731 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cca9b7d-80ec-40be-bfe2-1417b6978d93 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:43.745163 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cca9b7d-80ec-40be-bfe2-1417b6978d93 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:43.745865 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cca9b7d-80ec-40be-bfe2-1417b6978d93 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:43.746312 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cca9b7d-80ec-40be-bfe2-1417b6978d93 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:43.746753 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cca9b7d-80ec-40be-bfe2-1417b6978d93 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:43.761336 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-3cca9b7d-80ec-40be-bfe2-1417b6978d93 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] HTTP exception thrown: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3cca9b7d-80ec-40be-bfe2-1417b6978d93 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Request method failure captured: Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 HTTP/1.1 Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8woRMVyoU9aLaBHLfxWq3rhgSNfpDXsHrJ0JUVxxXk7N_vHMOu7IKDmy7Ln-hyMIN_NjduqULel4lJLROHRtQ-6Op9IQi2psaTOuqyihyzV19hZ7jrQEMS9G45jhSxfqzPTvA4Ts62X0j3XSTOZ7Ne8N5xbdyc_SaHiCOAAIt150ZA Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:33:43.763088 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:33:43.764748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d57c38134f1484d9b208de1b9d8e26e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:33:43.764748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:43.764748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:43.764748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:43.764748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:43.764748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:33:43.764748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:33:43.764748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 592da799f0c540d68a2cc6d54006467c Sep 09 23:33:43.764748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:43.764748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:33:43.764748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. Sep 09 23:33:43.764748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '0af84898-4d31-4109-ab87-199f3b65c034'} Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:33:43.765560 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. Sep 09 23:33:43.767245 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:43.769260 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3cca9b7d-80ec-40be-bfe2-1417b6978d93 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Returning 404 to user: Instance 0af84898-4d31-4109-ab87-199f3b65c034 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:33:43.769260 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3cca9b7d-80ec-40be-bfe2-1417b6978d93 tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034" status: 404 len: 111 microversion: 2.1 time: 0.030970 Sep 09 23:33:43.769260 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 574/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:43 2022] GET /compute/v2.1/servers/0af84898-4d31-4109-ab87-199f3b65c034 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:33:44.091198 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Flavor limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 23:33:44.091625 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Image limits 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 23:33:44.092119 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Flavor pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 23:33:44.092527 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Image pref 0:0:0 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 23:33:44.092934 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.virt.hardware [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 23:33:44.101597 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:44.102075 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:44.102561 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:44.103880 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:44.104332 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:44.104752 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:44.121921 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Getting quotas for project 8042eb99cd7047d4912b2f4b1e50936e. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 23:33:44.126102 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.quota [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Getting quotas for user 8c81c0af6f084b8db165fd51667b3b54 and project 8042eb99cd7047d4912b2f4b1e50936e. Resources: {'cores', 'instances', 'ram'} {{(pid=121058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 23:33:44.183753 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Going to run 1 instances... {{(pid=121058) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 23:33:44.185855 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='963340f9-b164-49b0-9f9c-501b63a2b033',volume_size=None,volume_type=None)] {{(pid=121058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 23:33:44.628090 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a8c61f17-01d8-47be-aa56-b9da66edd2ab tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.298323 Sep 09 23:33:44.629032 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 542/1116] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 23:33:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 23:33:44.639769 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-769989f8-5da8-490c-bae7-171cccbe2710 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:44.640456 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-769989f8-5da8-490c-bae7-171cccbe2710 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:44.693981 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-769989f8-5da8-490c-bae7-171cccbe2710 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:44.701454 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-769989f8-5da8-490c-bae7-171cccbe2710 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1095 microversion: 2.1 time: 0.065506 Sep 09 23:33:44.702014 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 575/1117] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:44 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:45.047521 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7389293b-373f-4092-a533-f9b4702006aa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:45.048021 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-7389293b-373f-4092-a533-f9b4702006aa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:45.054094 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7389293b-373f-4092-a533-f9b4702006aa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:45.054603 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7389293b-373f-4092-a533-f9b4702006aa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:45.055086 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7389293b-373f-4092-a533-f9b4702006aa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:45.056449 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7389293b-373f-4092-a533-f9b4702006aa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:45.057015 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7389293b-373f-4092-a533-f9b4702006aa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:45.057467 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-7389293b-373f-4092-a533-f9b4702006aa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:45.071000 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-7389293b-373f-4092-a533-f9b4702006aa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] HTTP exception thrown: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7389293b-373f-4092-a533-f9b4702006aa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Request method failure captured: Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: DELETE /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 HTTP/1.1 Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8woRMVyoU9aLaBHLfxWq3rhgSNfpDXsHrJ0JUVxxXk7N_vHMOu7IKDmy7Ln-hyMIN_NjduqULel4lJLROHRtQ-6Op9IQi2psaTOuqyihyzV19hZ7jrQEMS9G45jhSxfqzPTvA4Ts62X0j3XSTOZ7Ne8N5xbdyc_SaHiCOAAIt150ZA Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:33:45.072901 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:33:45.074632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d57c38134f1484d9b208de1b9d8e26e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:33:45.074632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:45.074632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:45.074632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:45.074632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:45.074632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:33:45.074632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:33:45.074632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 592da799f0c540d68a2cc6d54006467c Sep 09 23:33:45.074632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:45.074632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:33:45.074632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. Sep 09 23:33:45.074632 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '7f29a621-0596-49bf-b3bf-99b52cb9aa56'} Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:33:45.075551 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. Sep 09 23:33:45.076817 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:45.078068 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-7389293b-373f-4092-a533-f9b4702006aa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Returning 404 to user: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:33:45.078068 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-7389293b-373f-4092-a533-f9b4702006aa tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 404 len: 111 microversion: 2.1 time: 0.030752 Sep 09 23:33:45.078068 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 543/1118] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:33:45 2022] DELETE /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:33:45.083409 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8e133f54-9800-4645-8c4d-0e4e1bce88ac tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:45.084519 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8e133f54-9800-4645-8c4d-0e4e1bce88ac tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] [instance: 7f29a621-0596-49bf-b3bf-99b52cb9aa56] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:45.091371 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e133f54-9800-4645-8c4d-0e4e1bce88ac tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:45.091869 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e133f54-9800-4645-8c4d-0e4e1bce88ac tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:45.092313 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e133f54-9800-4645-8c4d-0e4e1bce88ac tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:45.093023 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e133f54-9800-4645-8c4d-0e4e1bce88ac tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:45.093484 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e133f54-9800-4645-8c4d-0e4e1bce88ac tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:45.093916 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8e133f54-9800-4645-8c4d-0e4e1bce88ac tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:45.107721 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-8e133f54-9800-4645-8c4d-0e4e1bce88ac tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] HTTP exception thrown: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8e133f54-9800-4645-8c4d-0e4e1bce88ac tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Request method failure captured: Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 HTTP/1.1 Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8woRMVyoU9aLaBHLfxWq3rhgSNfpDXsHrJ0JUVxxXk7N_vHMOu7IKDmy7Ln-hyMIN_NjduqULel4lJLROHRtQ-6Op9IQi2psaTOuqyihyzV19hZ7jrQEMS9G45jhSxfqzPTvA4Ts62X0j3XSTOZ7Ne8N5xbdyc_SaHiCOAAIt150ZA Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:33:45.109273 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:33:45.112582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d57c38134f1484d9b208de1b9d8e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d57c38134f1484d9b208de1b9d8e26e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:33:45.112582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:45.112582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 9d57c38134f1484d9b208de1b9d8e26e Sep 09 23:33:45.112582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390206982 Sep 09 23:33:45.112582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:45.112582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:33:45.112582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:33:45.112582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 592da799f0c540d68a2cc6d54006467c Sep 09 23:33:45.112582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-AttachVolumeNegativeTest-390206982-project Sep 09 23:33:45.112582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:33:45.112582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. Sep 09 23:33:45.112582 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '7f29a621-0596-49bf-b3bf-99b52cb9aa56'} Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:33:45.113350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. Sep 09 23:33:45.114935 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:33:45.116048 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8e133f54-9800-4645-8c4d-0e4e1bce88ac tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] Returning 404 to user: Instance 7f29a621-0596-49bf-b3bf-99b52cb9aa56 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:33:45.116048 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8e133f54-9800-4645-8c4d-0e4e1bce88ac tempest-AttachVolumeNegativeTest-390206982 tempest-AttachVolumeNegativeTest-390206982-project] 10.222.0.20 "GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56" status: 404 len: 111 microversion: 2.1 time: 0.031341 Sep 09 23:33:45.116048 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 576/1119] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:45 2022] GET /compute/v2.1/servers/7f29a621-0596-49bf-b3bf-99b52cb9aa56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:33:45.724221 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-eacc8bef-b99e-42f6-ad13-81d8eeb4e985 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:45.724866 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-eacc8bef-b99e-42f6-ad13-81d8eeb4e985 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:45.733499 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eacc8bef-b99e-42f6-ad13-81d8eeb4e985 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:45.733991 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eacc8bef-b99e-42f6-ad13-81d8eeb4e985 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:45.734460 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eacc8bef-b99e-42f6-ad13-81d8eeb4e985 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:45.735167 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eacc8bef-b99e-42f6-ad13-81d8eeb4e985 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:45.735626 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eacc8bef-b99e-42f6-ad13-81d8eeb4e985 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:45.736053 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-eacc8bef-b99e-42f6-ad13-81d8eeb4e985 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:45.830759 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-eacc8bef-b99e-42f6-ad13-81d8eeb4e985 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:45.839184 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-eacc8bef-b99e-42f6-ad13-81d8eeb4e985 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1137 microversion: 2.1 time: 0.118720 Sep 09 23:33:45.839774 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 544/1120] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:45 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1137 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:46.866377 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-e9e72b0d-7147-4bfe-9c5b-4943481adc3c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:46.866377 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-e9e72b0d-7147-4bfe-9c5b-4943481adc3c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:46.896898 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9e72b0d-7147-4bfe-9c5b-4943481adc3c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:46.897421 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9e72b0d-7147-4bfe-9c5b-4943481adc3c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:46.897969 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9e72b0d-7147-4bfe-9c5b-4943481adc3c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:46.898750 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9e72b0d-7147-4bfe-9c5b-4943481adc3c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:46.899219 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9e72b0d-7147-4bfe-9c5b-4943481adc3c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:46.900247 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-e9e72b0d-7147-4bfe-9c5b-4943481adc3c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:47.004182 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-e9e72b0d-7147-4bfe-9c5b-4943481adc3c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:47.014326 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-e9e72b0d-7147-4bfe-9c5b-4943481adc3c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1211 microversion: 2.1 time: 0.153857 Sep 09 23:33:47.015421 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 577/1121] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:46 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1211 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:48.043596 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-3e9283fb-4cd2-4ef9-a707-1a3ef54f542a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:48.044799 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-3e9283fb-4cd2-4ef9-a707-1a3ef54f542a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:48.053076 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3e9283fb-4cd2-4ef9-a707-1a3ef54f542a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:48.053834 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3e9283fb-4cd2-4ef9-a707-1a3ef54f542a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:48.054530 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3e9283fb-4cd2-4ef9-a707-1a3ef54f542a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:48.055407 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3e9283fb-4cd2-4ef9-a707-1a3ef54f542a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:48.056143 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3e9283fb-4cd2-4ef9-a707-1a3ef54f542a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:48.056751 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-3e9283fb-4cd2-4ef9-a707-1a3ef54f542a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:48.220839 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-3e9283fb-4cd2-4ef9-a707-1a3ef54f542a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:48.231344 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-3e9283fb-4cd2-4ef9-a707-1a3ef54f542a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1279 microversion: 2.1 time: 0.196867 Sep 09 23:33:48.233827 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 545/1122] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:48 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1279 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:48.642593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-cf7ce4fc-8299-47f4-8c97-e02f37bba25e req-ce059632-40ad-4960-a88c-c5855bc1b950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3208a9f1-7f59-4dd5-8cf2-a15202a32490", "tag": "f4bad87e-e6ae-4c9c-87a0-4367523ce224"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:33:48.653653 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-cf7ce4fc-8299-47f4-8c97-e02f37bba25e req-ce059632-40ad-4960-a88c-c5855bc1b950 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:48.654139 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-cf7ce4fc-8299-47f4-8c97-e02f37bba25e req-ce059632-40ad-4960-a88c-c5855bc1b950 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:48.657077 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-cf7ce4fc-8299-47f4-8c97-e02f37bba25e req-ce059632-40ad-4960-a88c-c5855bc1b950 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:48.666371 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-cf7ce4fc-8299-47f4-8c97-e02f37bba25e req-ce059632-40ad-4960-a88c-c5855bc1b950 service nova] Creating event network-changed:f4bad87e-e6ae-4c9c-87a0-4367523ce224 for instance 3208a9f1-7f59-4dd5-8cf2-a15202a32490 on hv-cinder-85032 Sep 09 23:33:48.671483 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-cf7ce4fc-8299-47f4-8c97-e02f37bba25e req-ce059632-40ad-4960-a88c-c5855bc1b950 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032963 Sep 09 23:33:48.672091 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 578/1123] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:33:49.254929 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-e7818abf-a5c2-4a96-af60-e3b55cb6f8db tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:49.255634 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-e7818abf-a5c2-4a96-af60-e3b55cb6f8db tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:49.262296 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7818abf-a5c2-4a96-af60-e3b55cb6f8db tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:49.264646 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7818abf-a5c2-4a96-af60-e3b55cb6f8db tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:49.264646 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7818abf-a5c2-4a96-af60-e3b55cb6f8db tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:49.264646 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7818abf-a5c2-4a96-af60-e3b55cb6f8db tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:49.264646 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7818abf-a5c2-4a96-af60-e3b55cb6f8db tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:49.265098 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-e7818abf-a5c2-4a96-af60-e3b55cb6f8db tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:49.482743 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-e7818abf-a5c2-4a96-af60-e3b55cb6f8db tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:49.491450 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-e7818abf-a5c2-4a96-af60-e3b55cb6f8db tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1267 microversion: 2.1 time: 0.240474 Sep 09 23:33:49.492032 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 546/1124] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:49 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:50.516208 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3cf2615b-bbf6-44d1-b2c5-da69935229a6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:50.517034 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3cf2615b-bbf6-44d1-b2c5-da69935229a6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:50.523065 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cf2615b-bbf6-44d1-b2c5-da69935229a6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:50.523555 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cf2615b-bbf6-44d1-b2c5-da69935229a6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:50.523995 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cf2615b-bbf6-44d1-b2c5-da69935229a6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:50.524743 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cf2615b-bbf6-44d1-b2c5-da69935229a6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:50.525463 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cf2615b-bbf6-44d1-b2c5-da69935229a6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:50.525925 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3cf2615b-bbf6-44d1-b2c5-da69935229a6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:50.664852 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3cf2615b-bbf6-44d1-b2c5-da69935229a6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:50.674119 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3cf2615b-bbf6-44d1-b2c5-da69935229a6 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1267 microversion: 2.1 time: 0.162553 Sep 09 23:33:50.674923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 579/1125] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:50 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:50.831611 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8ddd7e35-12d4-4de5-8945-cf146fcfe09c tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] Action: 'create', calling method: .version_select at 0x7f908dc5c1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1201604957", "metadata": {"Type": "work"}}} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:33:51.425686 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8ddd7e35-12d4-4de5-8945-cf146fcfe09c tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.709510 Sep 09 23:33:51.426376 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 547/1126] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Sep 9 23:33:50 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 711 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 23:33:51.439401 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-87cdf48d-3941-4f29-89c8-aab2cbe3fad2 tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] Calling method '.version_select at 0x7f908dbd2dc0>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:51.488041 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-87cdf48d-3941-4f29-89c8-aab2cbe3fad2 tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/81244704-dd0a-47f7-87ad-55b04ed6c4ce" status: 200 len: 353 microversion: 2.1 time: 0.052482 Sep 09 23:33:51.488598 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 580/1127] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 23:33:51 2022] GET /compute/v2.1/os-volumes/81244704-dd0a-47f7-87ad-55b04ed6c4ce => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:33:51.697933 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-2408f42f-551c-47ba-bb18-120f94737905 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:51.698629 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-2408f42f-551c-47ba-bb18-120f94737905 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:51.704571 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2408f42f-551c-47ba-bb18-120f94737905 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:51.705049 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2408f42f-551c-47ba-bb18-120f94737905 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:51.705482 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2408f42f-551c-47ba-bb18-120f94737905 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:51.706167 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2408f42f-551c-47ba-bb18-120f94737905 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:51.706664 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2408f42f-551c-47ba-bb18-120f94737905 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:51.707089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-2408f42f-551c-47ba-bb18-120f94737905 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:51.835608 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-2408f42f-551c-47ba-bb18-120f94737905 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:51.843902 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-2408f42f-551c-47ba-bb18-120f94737905 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1267 microversion: 2.1 time: 0.150599 Sep 09 23:33:51.844466 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 548/1128] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:51 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:52.503307 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-f3d3d994-fb84-482e-9ae3-76df6f7218dd tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] Calling method '.version_select at 0x7f908dbdf8b0>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:52.551225 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-f3d3d994-fb84-482e-9ae3-76df6f7218dd tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/81244704-dd0a-47f7-87ad-55b04ed6c4ce" status: 200 len: 354 microversion: 2.1 time: 0.052347 Sep 09 23:33:52.551789 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 581/1129] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 23:33:52 2022] GET /compute/v2.1/os-volumes/81244704-dd0a-47f7-87ad-55b04ed6c4ce => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:33:52.565082 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-a59d8cf6-91ee-4187-bf80-d1ce94e61e61 tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] Calling method '.version_select at 0x7f908db6c790>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:52.611421 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-a59d8cf6-91ee-4187-bf80-d1ce94e61e61 tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/81244704-dd0a-47f7-87ad-55b04ed6c4ce" status: 200 len: 354 microversion: 2.1 time: 0.050172 Sep 09 23:33:52.612019 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 549/1130] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 23:33:52 2022] GET /compute/v2.1/os-volumes/81244704-dd0a-47f7-87ad-55b04ed6c4ce => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:33:52.630238 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fe327719-0212-4d59-8fc8-254180cb2f4f tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] Calling method '.version_select at 0x7f908dd9b160>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:52.779786 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-fe327719-0212-4d59-8fc8-254180cb2f4f tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/81244704-dd0a-47f7-87ad-55b04ed6c4ce" status: 202 len: 0 microversion: 2.1 time: 0.153364 Sep 09 23:33:52.780349 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 582/1131] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 23:33:52 2022] DELETE /compute/v2.1/os-volumes/81244704-dd0a-47f7-87ad-55b04ed6c4ce => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 23:33:52.789274 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-2538f0dc-8e7c-4688-89e8-7bd01dc8fb74 tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] Calling method '.version_select at 0x7f908dc9d040>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:52.837232 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-2538f0dc-8e7c-4688-89e8-7bd01dc8fb74 tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/81244704-dd0a-47f7-87ad-55b04ed6c4ce" status: 200 len: 353 microversion: 2.1 time: 0.051655 Sep 09 23:33:52.837232 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 550/1132] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 23:33:52 2022] GET /compute/v2.1/os-volumes/81244704-dd0a-47f7-87ad-55b04ed6c4ce => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:33:52.866625 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-fcc360f6-77de-4337-8e88-2f726e6a8185 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:52.867234 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-fcc360f6-77de-4337-8e88-2f726e6a8185 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:52.874221 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fcc360f6-77de-4337-8e88-2f726e6a8185 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:52.874736 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fcc360f6-77de-4337-8e88-2f726e6a8185 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:52.875173 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fcc360f6-77de-4337-8e88-2f726e6a8185 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:52.875855 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fcc360f6-77de-4337-8e88-2f726e6a8185 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:52.876310 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fcc360f6-77de-4337-8e88-2f726e6a8185 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:52.876739 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-fcc360f6-77de-4337-8e88-2f726e6a8185 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:53.008845 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-fcc360f6-77de-4337-8e88-2f726e6a8185 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:53.017197 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-fcc360f6-77de-4337-8e88-2f726e6a8185 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1267 microversion: 2.1 time: 0.154815 Sep 09 23:33:53.017780 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 583/1133] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:52 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:53.851494 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-6e8ccf8b-c6c5-4217-9227-e043fbb3498a tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] Calling method '.version_select at 0x7f908dc473a0>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:53.880029 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-6e8ccf8b-c6c5-4217-9227-e043fbb3498a tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] HTTP exception thrown: Volume 81244704-dd0a-47f7-87ad-55b04ed6c4ce could not be found. Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-6e8ccf8b-c6c5-4217-9227-e043fbb3498a tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] Request method failure captured: Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/os-volumes/81244704-dd0a-47f7-87ad-55b04ed6c4ce HTTP/1.1 Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG81eebwpNtR4ISnTCpOMz2vBuJ6nJiPDFP4oAegtWppz4ebTqxOAjH_1nyerfR0HT0C_gsXBOH5JhSJWjnaM4hK95IKbyBef9tQx5KxK8PMl1gp6QoTn6E7ArI4uigQEwMH9AMuZdHiKgWjKMhwAeucBzgUEi2I7vkxK-8XStUivETU Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 05c30e8c72d6449e8defe028dc0b176b Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-VolumesGetTestJSON-1105797137 Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:33:53.882012 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:33:53.883695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05c30e8c72d6449e8defe028dc0b176b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/05c30e8c72d6449e8defe028dc0b176b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05c30e8c72d6449e8defe028dc0b176b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_05c30e8c72d6449e8defe028dc0b176b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:33:53.883695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-VolumesGetTestJSON-1105797137 Sep 09 23:33:53.883695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 05c30e8c72d6449e8defe028dc0b176b Sep 09 23:33:53.883695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-VolumesGetTestJSON-1105797137 Sep 09 23:33:53.883695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-VolumesGetTestJSON-1105797137-project Sep 09 23:33:53.883695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:33:53.883695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:33:53.883695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 275b3ea11e66495eacd10abbfb7fb0d2 Sep 09 23:33:53.883695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-VolumesGetTestJSON-1105797137-project Sep 09 23:33:53.883695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: Sep 09 23:33:53.883695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Volume 81244704-dd0a-47f7-87ad-55b04ed6c4ce could not be found. Sep 09 23:33:53.883695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '81244704-dd0a-47f7-87ad-55b04ed6c4ce'} Sep 09 23:33:53.883695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81244704-dd0a-47f7-87ad-55b04ed6c4ce could not be found. (HTTP 404) (Request-ID: req-5cbd2b44-b212-4932-bd99-ce4332fe2808) Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:53.884750 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 23:33:53.886713 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81244704-dd0a-47f7-87ad-55b04ed6c4ce could not be found. Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 23:33:53.888279 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:33:53.889740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81244704-dd0a-47f7-87ad-55b04ed6c4ce could not be found. Sep 09 23:33:53.889740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:53.889740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:33:53.889740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:53.889740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:33:53.889740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:33:53.889740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:33:53.889740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:33:53.889740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:33:53.889740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81244704-dd0a-47f7-87ad-55b04ed6c4ce could not be found. Sep 09 23:33:53.889740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:33:53.889740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-6e8ccf8b-c6c5-4217-9227-e043fbb3498a tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] Returning 404 to user: Volume 81244704-dd0a-47f7-87ad-55b04ed6c4ce could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:33:53.889740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-6e8ccf8b-c6c5-4217-9227-e043fbb3498a tempest-VolumesGetTestJSON-1105797137 tempest-VolumesGetTestJSON-1105797137-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/81244704-dd0a-47f7-87ad-55b04ed6c4ce" status: 404 len: 109 microversion: 2.1 time: 0.036383 Sep 09 23:33:53.889740 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 551/1134] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 23:33:53 2022] GET /compute/v2.1/os-volumes/81244704-dd0a-47f7-87ad-55b04ed6c4ce => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:33:54.040910 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-08e01571-8a36-473f-9fb0-810828d8c558 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:54.041588 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-08e01571-8a36-473f-9fb0-810828d8c558 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:54.048011 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08e01571-8a36-473f-9fb0-810828d8c558 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:54.048496 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08e01571-8a36-473f-9fb0-810828d8c558 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:54.048930 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08e01571-8a36-473f-9fb0-810828d8c558 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:54.049616 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08e01571-8a36-473f-9fb0-810828d8c558 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:54.050067 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08e01571-8a36-473f-9fb0-810828d8c558 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:54.050523 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-08e01571-8a36-473f-9fb0-810828d8c558 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:54.186567 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-08e01571-8a36-473f-9fb0-810828d8c558 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:54.194350 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-08e01571-8a36-473f-9fb0-810828d8c558 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1267 microversion: 2.1 time: 0.157366 Sep 09 23:33:54.194924 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 584/1135] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:54 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:55.215238 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=2 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:33:55.216068 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell0:SELECT=6 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:33:55.220407 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c4e4d048-fff6-4122-8d08-683f8be39bf4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:55.221022 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c4e4d048-fff6-4122-8d08-683f8be39bf4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:55.222874 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:33:55.228021 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c4e4d048-fff6-4122-8d08-683f8be39bf4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:55.228514 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c4e4d048-fff6-4122-8d08-683f8be39bf4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:55.229627 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c4e4d048-fff6-4122-8d08-683f8be39bf4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:55.230329 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c4e4d048-fff6-4122-8d08-683f8be39bf4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:55.230815 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c4e4d048-fff6-4122-8d08-683f8be39bf4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:55.231254 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c4e4d048-fff6-4122-8d08-683f8be39bf4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:55.235198 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:33:55.366597 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-c4e4d048-fff6-4122-8d08-683f8be39bf4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:55.374550 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c4e4d048-fff6-4122-8d08-683f8be39bf4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1267 microversion: 2.1 time: 0.160111 Sep 09 23:33:55.375222 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 552/1136] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:55 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:56.397956 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3503fc37-a635-4af4-baed-ae28ed693ce4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:56.398600 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3503fc37-a635-4af4-baed-ae28ed693ce4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:56.400622 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell0:SELECT=2 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:33:56.406979 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3503fc37-a635-4af4-baed-ae28ed693ce4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:56.419894 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3503fc37-a635-4af4-baed-ae28ed693ce4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:56.419894 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3503fc37-a635-4af4-baed-ae28ed693ce4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:56.419894 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3503fc37-a635-4af4-baed-ae28ed693ce4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:56.419894 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3503fc37-a635-4af4-baed-ae28ed693ce4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:56.420311 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3503fc37-a635-4af4-baed-ae28ed693ce4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:56.550259 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3503fc37-a635-4af4-baed-ae28ed693ce4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:56.558867 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3503fc37-a635-4af4-baed-ae28ed693ce4 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1267 microversion: 2.1 time: 0.164731 Sep 09 23:33:56.559448 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 585/1137] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:56 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:57.582695 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-8bd05a09-76b1-45ca-8e2a-6e5f365d998d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:57.583322 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-8bd05a09-76b1-45ca-8e2a-6e5f365d998d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:57.591191 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8bd05a09-76b1-45ca-8e2a-6e5f365d998d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:57.591681 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8bd05a09-76b1-45ca-8e2a-6e5f365d998d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:57.592120 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8bd05a09-76b1-45ca-8e2a-6e5f365d998d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:57.598164 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8bd05a09-76b1-45ca-8e2a-6e5f365d998d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:57.598164 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8bd05a09-76b1-45ca-8e2a-6e5f365d998d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:57.598164 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-8bd05a09-76b1-45ca-8e2a-6e5f365d998d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:57.730424 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-8bd05a09-76b1-45ca-8e2a-6e5f365d998d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:57.739538 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-8bd05a09-76b1-45ca-8e2a-6e5f365d998d tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1267 microversion: 2.1 time: 0.160818 Sep 09 23:33:57.745760 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 553/1138] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:57 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:33:58.763557 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-cd447b58-f5f2-491c-8b13-e22a6b22fb1a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:58.764167 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-cd447b58-f5f2-491c-8b13-e22a6b22fb1a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:58.770555 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd447b58-f5f2-491c-8b13-e22a6b22fb1a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:58.771126 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd447b58-f5f2-491c-8b13-e22a6b22fb1a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:58.771557 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd447b58-f5f2-491c-8b13-e22a6b22fb1a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:58.772280 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd447b58-f5f2-491c-8b13-e22a6b22fb1a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:58.772729 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd447b58-f5f2-491c-8b13-e22a6b22fb1a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:58.773148 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cd447b58-f5f2-491c-8b13-e22a6b22fb1a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:58.914609 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cd447b58-f5f2-491c-8b13-e22a6b22fb1a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:33:58.922716 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-cd447b58-f5f2-491c-8b13-e22a6b22fb1a tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1267 microversion: 2.1 time: 0.163869 Sep 09 23:33:58.923611 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 586/1139] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:58 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:33:59.693495 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-4243fa2f-7784-40d6-8c10-ab1447625c19 req-a71f0242-9f73-4f2f-83f3-64b49509897d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3208a9f1-7f59-4dd5-8cf2-a15202a32490", "name": "network-vif-plugged", "status": "completed", "tag": "f4bad87e-e6ae-4c9c-87a0-4367523ce224"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:33:59.704253 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-4243fa2f-7784-40d6-8c10-ab1447625c19 req-a71f0242-9f73-4f2f-83f3-64b49509897d service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:59.704726 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-4243fa2f-7784-40d6-8c10-ab1447625c19 req-a71f0242-9f73-4f2f-83f3-64b49509897d service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:59.705153 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-4243fa2f-7784-40d6-8c10-ab1447625c19 req-a71f0242-9f73-4f2f-83f3-64b49509897d service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:59.716430 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-4243fa2f-7784-40d6-8c10-ab1447625c19 req-a71f0242-9f73-4f2f-83f3-64b49509897d service nova] Creating event network-vif-plugged:f4bad87e-e6ae-4c9c-87a0-4367523ce224 for instance 3208a9f1-7f59-4dd5-8cf2-a15202a32490 on hv-cinder-85032 Sep 09 23:33:59.722604 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-4243fa2f-7784-40d6-8c10-ab1447625c19 req-a71f0242-9f73-4f2f-83f3-64b49509897d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031704 Sep 09 23:33:59.722604 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 554/1140] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:33:59.945292 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-cce80b0e-8ab6-45f8-9880-5fc1005284f0 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:33:59.945923 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-cce80b0e-8ab6-45f8-9880-5fc1005284f0 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:33:59.953562 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cce80b0e-8ab6-45f8-9880-5fc1005284f0 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:59.953562 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cce80b0e-8ab6-45f8-9880-5fc1005284f0 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:59.954507 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cce80b0e-8ab6-45f8-9880-5fc1005284f0 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:59.954711 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cce80b0e-8ab6-45f8-9880-5fc1005284f0 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:33:59.956151 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cce80b0e-8ab6-45f8-9880-5fc1005284f0 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:33:59.956151 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-cce80b0e-8ab6-45f8-9880-5fc1005284f0 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:33:59.974678 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:34:00.093792 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-cce80b0e-8ab6-45f8-9880-5fc1005284f0 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:34:00.101640 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-cce80b0e-8ab6-45f8-9880-5fc1005284f0 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1267 microversion: 2.1 time: 0.160465 Sep 09 23:34:00.102220 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 587/1141] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:33:59 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:34:01.126376 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-919f8401-e9dc-4d18-bd0e-e73293f69b89 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:34:01.127051 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-919f8401-e9dc-4d18-bd0e-e73293f69b89 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:34:01.133218 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-919f8401-e9dc-4d18-bd0e-e73293f69b89 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:34:01.133706 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-919f8401-e9dc-4d18-bd0e-e73293f69b89 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:34:01.134148 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-919f8401-e9dc-4d18-bd0e-e73293f69b89 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:34:01.134876 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-919f8401-e9dc-4d18-bd0e-e73293f69b89 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:34:01.135336 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-919f8401-e9dc-4d18-bd0e-e73293f69b89 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:34:01.135773 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-919f8401-e9dc-4d18-bd0e-e73293f69b89 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:34:01.266400 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-919f8401-e9dc-4d18-bd0e-e73293f69b89 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:34:01.274160 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-919f8401-e9dc-4d18-bd0e-e73293f69b89 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1267 microversion: 2.1 time: 0.153043 Sep 09 23:34:01.274758 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 555/1142] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:34:01 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:34:02.297377 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-5d23fc4c-82ad-42e9-a110-f41cfb813675 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:34:02.297943 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-5d23fc4c-82ad-42e9-a110-f41cfb813675 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:34:02.300232 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:34:02.304865 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d23fc4c-82ad-42e9-a110-f41cfb813675 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:34:02.305345 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d23fc4c-82ad-42e9-a110-f41cfb813675 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:34:02.305778 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d23fc4c-82ad-42e9-a110-f41cfb813675 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:34:02.307748 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d23fc4c-82ad-42e9-a110-f41cfb813675 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:34:02.308202 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d23fc4c-82ad-42e9-a110-f41cfb813675 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:34:02.312823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-5d23fc4c-82ad-42e9-a110-f41cfb813675 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:34:02.441410 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-5d23fc4c-82ad-42e9-a110-f41cfb813675 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:34:02.449995 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-5d23fc4c-82ad-42e9-a110-f41cfb813675 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1267 microversion: 2.1 time: 0.156063 Sep 09 23:34:02.450607 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 588/1143] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:34:02 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:34:03.641988 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-af0ef9ae-0019-4d51-8ecc-020806d4c05c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:34:03.642766 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-af0ef9ae-0019-4d51-8ecc-020806d4c05c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:34:03.648525 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-af0ef9ae-0019-4d51-8ecc-020806d4c05c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:34:03.649007 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-af0ef9ae-0019-4d51-8ecc-020806d4c05c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:34:03.649445 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-af0ef9ae-0019-4d51-8ecc-020806d4c05c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:34:03.650137 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-af0ef9ae-0019-4d51-8ecc-020806d4c05c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:34:03.650628 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-af0ef9ae-0019-4d51-8ecc-020806d4c05c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:34:03.651110 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-af0ef9ae-0019-4d51-8ecc-020806d4c05c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:34:03.784869 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-af0ef9ae-0019-4d51-8ecc-020806d4c05c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:34:03.792510 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-af0ef9ae-0019-4d51-8ecc-020806d4c05c tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1267 microversion: 2.1 time: 0.323012 Sep 09 23:34:03.793286 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 556/1144] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:34:03 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1267 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:34:04.815328 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-bd9fdf3d-bdc1-474e-8c1c-a63caa86b484 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:34:04.815948 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-bd9fdf3d-bdc1-474e-8c1c-a63caa86b484 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:34:04.822611 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bd9fdf3d-bdc1-474e-8c1c-a63caa86b484 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:34:04.823105 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bd9fdf3d-bdc1-474e-8c1c-a63caa86b484 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:34:04.823550 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bd9fdf3d-bdc1-474e-8c1c-a63caa86b484 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:34:04.824253 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bd9fdf3d-bdc1-474e-8c1c-a63caa86b484 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:34:04.824726 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bd9fdf3d-bdc1-474e-8c1c-a63caa86b484 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:34:04.825781 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-bd9fdf3d-bdc1-474e-8c1c-a63caa86b484 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:34:04.969529 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-bd9fdf3d-bdc1-474e-8c1c-a63caa86b484 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:34:04.977376 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-bd9fdf3d-bdc1-474e-8c1c-a63caa86b484 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1455 microversion: 2.1 time: 0.166185 Sep 09 23:34:04.977942 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 589/1145] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:34:04 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:34:05.000262 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-4b28e94b-9d33-447f-acb0-cd5db3df7700 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:34:05.000888 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-4b28e94b-9d33-447f-acb0-cd5db3df7700 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:34:05.007182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b28e94b-9d33-447f-acb0-cd5db3df7700 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:34:05.007670 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b28e94b-9d33-447f-acb0-cd5db3df7700 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:34:05.008111 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b28e94b-9d33-447f-acb0-cd5db3df7700 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:34:05.008805 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b28e94b-9d33-447f-acb0-cd5db3df7700 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:34:05.009264 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b28e94b-9d33-447f-acb0-cd5db3df7700 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:34:05.009694 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-4b28e94b-9d33-447f-acb0-cd5db3df7700 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:34:05.138252 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-4b28e94b-9d33-447f-acb0-cd5db3df7700 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:34:05.146039 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-4b28e94b-9d33-447f-acb0-cd5db3df7700 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1455 microversion: 2.1 time: 0.150062 Sep 09 23:34:05.146637 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 557/1146] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:34:04 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1455 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:34:07.380487 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-54da4621-c178-4474-a5b1-05ebe459a883 req-7a654efb-c494-494f-ba06-4ef3eec436c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3208a9f1-7f59-4dd5-8cf2-a15202a32490", "tag": "f4bad87e-e6ae-4c9c-87a0-4367523ce224"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:34:07.391424 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-54da4621-c178-4474-a5b1-05ebe459a883 req-7a654efb-c494-494f-ba06-4ef3eec436c6 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:34:07.391897 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-54da4621-c178-4474-a5b1-05ebe459a883 req-7a654efb-c494-494f-ba06-4ef3eec436c6 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:34:07.392356 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-54da4621-c178-4474-a5b1-05ebe459a883 req-7a654efb-c494-494f-ba06-4ef3eec436c6 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:34:07.406121 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-54da4621-c178-4474-a5b1-05ebe459a883 req-7a654efb-c494-494f-ba06-4ef3eec436c6 service nova] Creating event network-changed:f4bad87e-e6ae-4c9c-87a0-4367523ce224 for instance 3208a9f1-7f59-4dd5-8cf2-a15202a32490 on hv-cinder-85032 Sep 09 23:34:07.411112 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-54da4621-c178-4474-a5b1-05ebe459a883 req-7a654efb-c494-494f-ba06-4ef3eec436c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034312 Sep 09 23:34:07.412040 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 590/1147] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:35:36.712969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3048eab1-85cf-40ca-8939-cb6e36390670] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 09 23:35:36.712969 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_api:SELECT=11 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:35:36.713857 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_api:SELECT=5 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:35:36.714682 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG dbcounter [-] [121059] Writing DB stats nova_cell1:SELECT=16 {{(pid=121059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:35:36.714822 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG dbcounter [-] [121058] Writing DB stats nova_cell1:SELECT=31 {{(pid=121058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 23:35:36.715887 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 23:35:36.716017 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Fri Sep 9 23:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 (ip 10.222.0.20) !!! Sep 09 23:35:36.716110 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 23:35:36.716256 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Fri Sep 9 23:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 09 23:35:36.721385 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-70082977-e084-400f-940c-0e26872d22a1 req-d0bf7c07-c765-41dc-a954-a1792e577803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3208a9f1-7f59-4dd5-8cf2-a15202a32490", "tag": "f4bad87e-e6ae-4c9c-87a0-4367523ce224"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:35:36.722663 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-9ef0a377-3938-4732-a6d8-d820f8eb03c7 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:35:36.723988 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9ef0a377-3938-4732-a6d8-d820f8eb03c7 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:35:36.733296 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-70082977-e084-400f-940c-0e26872d22a1 req-d0bf7c07-c765-41dc-a954-a1792e577803 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:36.735471 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-70082977-e084-400f-940c-0e26872d22a1 req-d0bf7c07-c765-41dc-a954-a1792e577803 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:36.735471 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-70082977-e084-400f-940c-0e26872d22a1 req-d0bf7c07-c765-41dc-a954-a1792e577803 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:36.738013 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ef0a377-3938-4732-a6d8-d820f8eb03c7 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:36.738555 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ef0a377-3938-4732-a6d8-d820f8eb03c7 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:36.739255 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ef0a377-3938-4732-a6d8-d820f8eb03c7 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:36.739875 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ef0a377-3938-4732-a6d8-d820f8eb03c7 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:36.743389 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ef0a377-3938-4732-a6d8-d820f8eb03c7 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:36.743389 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-9ef0a377-3938-4732-a6d8-d820f8eb03c7 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:36.749147 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-70082977-e084-400f-940c-0e26872d22a1 req-d0bf7c07-c765-41dc-a954-a1792e577803 service nova] Creating event network-changed:f4bad87e-e6ae-4c9c-87a0-4367523ce224 for instance 3208a9f1-7f59-4dd5-8cf2-a15202a32490 on hv-cinder-85032 Sep 09 23:35:36.754593 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-70082977-e084-400f-940c-0e26872d22a1 req-d0bf7c07-c765-41dc-a954-a1792e577803 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042861 Sep 09 23:35:36.758419 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 591/1148] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:35:36.775275 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-9ef0a377-3938-4732-a6d8-d820f8eb03c7 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Going to try to terminate instance {{(pid=121058) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:35:37.064308 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-9ef0a377-3938-4732-a6d8-d820f8eb03c7 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 204 len: 0 microversion: 2.1 time: 0.355046 Sep 09 23:35:37.065093 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 558/1149] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:35:36 2022] DELETE /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:35:37.075591 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-89eea49f-3c4c-4139-9285-19bcce613392 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:35:37.076300 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-89eea49f-3c4c-4139-9285-19bcce613392 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:35:37.084309 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-89eea49f-3c4c-4139-9285-19bcce613392 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:37.084891 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-89eea49f-3c4c-4139-9285-19bcce613392 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:37.085511 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-89eea49f-3c4c-4139-9285-19bcce613392 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:37.086576 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-89eea49f-3c4c-4139-9285-19bcce613392 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:37.087085 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-89eea49f-3c4c-4139-9285-19bcce613392 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:37.087699 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-89eea49f-3c4c-4139-9285-19bcce613392 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:37.246882 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-89eea49f-3c4c-4139-9285-19bcce613392 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:35:37.255775 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-89eea49f-3c4c-4139-9285-19bcce613392 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1579 microversion: 2.1 time: 0.185107 Sep 09 23:35:37.256554 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 592/1150] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:35:37 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1579 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 23:35:38.282880 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-558227e8-782e-4e9f-a512-38d201b88696 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:35:38.283581 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-558227e8-782e-4e9f-a512-38d201b88696 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:35:38.292454 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-558227e8-782e-4e9f-a512-38d201b88696 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:38.292928 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-558227e8-782e-4e9f-a512-38d201b88696 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:38.293363 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-558227e8-782e-4e9f-a512-38d201b88696 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:38.294059 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-558227e8-782e-4e9f-a512-38d201b88696 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:38.294546 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-558227e8-782e-4e9f-a512-38d201b88696 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:38.295181 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-558227e8-782e-4e9f-a512-38d201b88696 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:38.300778 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO oslo.messaging._drivers.impl_rabbit [-] [3048eab1-85cf-40ca-8939-cb6e36390670] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47720. Sep 09 23:35:38.584677 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-558227e8-782e-4e9f-a512-38d201b88696 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:35:38.592697 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-558227e8-782e-4e9f-a512-38d201b88696 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1579 microversion: 2.1 time: 0.314067 Sep 09 23:35:38.593292 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 559/1151] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:35:38 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1579 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:35:39.433236 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [req-f83d1b04-57be-4a68-b9e3-6ef5376d03f4 req-c3718c5d-81e6-4a03-a231-2f34ad34b2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3208a9f1-7f59-4dd5-8cf2-a15202a32490", "name": "network-vif-deleted", "tag": "f4bad87e-e6ae-4c9c-87a0-4367523ce224"}]} {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:35:39.443347 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-f83d1b04-57be-4a68-b9e3-6ef5376d03f4 req-c3718c5d-81e6-4a03-a231-2f34ad34b2d8 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:39.443823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-f83d1b04-57be-4a68-b9e3-6ef5376d03f4 req-c3718c5d-81e6-4a03-a231-2f34ad34b2d8 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:39.444249 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [req-f83d1b04-57be-4a68-b9e3-6ef5376d03f4 req-c3718c5d-81e6-4a03-a231-2f34ad34b2d8 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:39.455221 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.compute.server_external_events [req-f83d1b04-57be-4a68-b9e3-6ef5376d03f4 req-c3718c5d-81e6-4a03-a231-2f34ad34b2d8 service nova] Creating event network-vif-deleted:f4bad87e-e6ae-4c9c-87a0-4367523ce224 for instance 3208a9f1-7f59-4dd5-8cf2-a15202a32490 on hv-cinder-85032 Sep 09 23:35:39.460727 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [req-f83d1b04-57be-4a68-b9e3-6ef5376d03f4 req-c3718c5d-81e6-4a03-a231-2f34ad34b2d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031152 Sep 09 23:35:39.461300 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 593/1152] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 23:35:39.620433 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-71be7c67-1d2b-478b-8024-b34d3339e5c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:35:39.621010 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-71be7c67-1d2b-478b-8024-b34d3339e5c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:35:39.627306 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71be7c67-1d2b-478b-8024-b34d3339e5c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:39.627829 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71be7c67-1d2b-478b-8024-b34d3339e5c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:39.628264 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71be7c67-1d2b-478b-8024-b34d3339e5c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:39.628952 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71be7c67-1d2b-478b-8024-b34d3339e5c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:39.630019 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71be7c67-1d2b-478b-8024-b34d3339e5c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:39.630723 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-71be7c67-1d2b-478b-8024-b34d3339e5c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:39.696802 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-71be7c67-1d2b-478b-8024-b34d3339e5c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:35:39.707460 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-71be7c67-1d2b-478b-8024-b34d3339e5c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1226 microversion: 2.1 time: 0.091169 Sep 09 23:35:39.708595 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 560/1153] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:35:39 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:35:40.731361 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-3034ab1f-53d5-4dc4-b39a-d74dadf044ff tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:35:40.732055 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-3034ab1f-53d5-4dc4-b39a-d74dadf044ff tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:35:40.738128 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3034ab1f-53d5-4dc4-b39a-d74dadf044ff tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:40.738639 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3034ab1f-53d5-4dc4-b39a-d74dadf044ff tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:40.739695 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3034ab1f-53d5-4dc4-b39a-d74dadf044ff tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:40.740476 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3034ab1f-53d5-4dc4-b39a-d74dadf044ff tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:40.740934 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3034ab1f-53d5-4dc4-b39a-d74dadf044ff tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:40.741383 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3034ab1f-53d5-4dc4-b39a-d74dadf044ff tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:40.773151 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3034ab1f-53d5-4dc4-b39a-d74dadf044ff tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:40.775823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3034ab1f-53d5-4dc4-b39a-d74dadf044ff tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:40.775823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-3034ab1f-53d5-4dc4-b39a-d74dadf044ff tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:40.775823 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.objects.instance [None req-3034ab1f-53d5-4dc4-b39a-d74dadf044ff tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lazy-loading 'fault' on Instance uuid 3208a9f1-7f59-4dd5-8cf2-a15202a32490 {{(pid=121059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 23:35:40.817346 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-3034ab1f-53d5-4dc4-b39a-d74dadf044ff tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:35:40.825537 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-3034ab1f-53d5-4dc4-b39a-d74dadf044ff tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 200 len: 1231 microversion: 2.1 time: 0.099025 Sep 09 23:35:40.837826 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 594/1154] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:35:40 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:35:41.848950 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-02925084-0e77-407e-96f8-17a522f7002e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:35:41.849568 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-02925084-0e77-407e-96f8-17a522f7002e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 3208a9f1-7f59-4dd5-8cf2-a15202a32490] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:35:41.856542 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02925084-0e77-407e-96f8-17a522f7002e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:41.857032 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02925084-0e77-407e-96f8-17a522f7002e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:41.857473 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02925084-0e77-407e-96f8-17a522f7002e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:41.858166 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02925084-0e77-407e-96f8-17a522f7002e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:41.858665 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02925084-0e77-407e-96f8-17a522f7002e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:41.859100 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-02925084-0e77-407e-96f8-17a522f7002e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:41.872638 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-02925084-0e77-407e-96f8-17a522f7002e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] HTTP exception thrown: Instance 3208a9f1-7f59-4dd5-8cf2-a15202a32490 could not be found. Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-02925084-0e77-407e-96f8-17a522f7002e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Request method failure captured: Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 HTTP/1.1 Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8w1jhDZJe0FlEHFn-Uk3JIz2iO-zQw8kgYSPCECy1gvaKWNHHmi9qfeJ8dL8KBR9xLyhJjx-YPB-onU_SL1WA92vQmhaLX903PFXCOXoS2_ZUvYsLbR1xcv8oIkbHwphE3Ud0RfReWw4dVzeF0H1d6p_HOwpobgoO5WYl8Baq9M0nM Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 8042eb99cd7047d4912b2f4b1e50936e Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-TestVolumeBootPattern-318475639 Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:35:41.874278 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:35:41.876073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8042eb99cd7047d4912b2f4b1e50936e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8042eb99cd7047d4912b2f4b1e50936e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8042eb99cd7047d4912b2f4b1e50936e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8042eb99cd7047d4912b2f4b1e50936e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:35:41.876073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-TestVolumeBootPattern-318475639 Sep 09 23:35:41.876073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 8042eb99cd7047d4912b2f4b1e50936e Sep 09 23:35:41.876073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-TestVolumeBootPattern-318475639 Sep 09 23:35:41.876073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-TestVolumeBootPattern-318475639-project Sep 09 23:35:41.876073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:35:41.876073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:35:41.876073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 8c81c0af6f084b8db165fd51667b3b54 Sep 09 23:35:41.876073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-TestVolumeBootPattern-318475639-project Sep 09 23:35:41.876073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:35:41.876073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 3208a9f1-7f59-4dd5-8cf2-a15202a32490 could not be found. Sep 09 23:35:41.876073 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '3208a9f1-7f59-4dd5-8cf2-a15202a32490'} Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3208a9f1-7f59-4dd5-8cf2-a15202a32490 could not be found. Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:35:41.877089 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3208a9f1-7f59-4dd5-8cf2-a15202a32490 could not be found. Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3208a9f1-7f59-4dd5-8cf2-a15202a32490 could not be found. Sep 09 23:35:41.878579 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:35:41.879836 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-02925084-0e77-407e-96f8-17a522f7002e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Returning 404 to user: Instance 3208a9f1-7f59-4dd5-8cf2-a15202a32490 could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:35:41.879836 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-02925084-0e77-407e-96f8-17a522f7002e tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490" status: 404 len: 111 microversion: 2.1 time: 0.030635 Sep 09 23:35:41.879836 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 561/1155] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:35:41 2022] GET /compute/v2.1/servers/3208a9f1-7f59-4dd5-8cf2-a15202a32490 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:35:45.453832 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-8d7a6f58-1ec9-4587-9796-04dfa8a74b13 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:35:45.454357 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8d7a6f58-1ec9-4587-9796-04dfa8a74b13 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:35:45.456269 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-a1eaadd6-0264-4b42-871f-2fc9d5739c4d req-25c97d86-83d2-43fd-a4f6-bc2e3f12fdd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75316fb8-2a0f-4676-8896-d90ca8e9419c", "tag": "783bedf3-9fb9-4027-bf33-a7a0ccbdc941"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:35:45.461813 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d7a6f58-1ec9-4587-9796-04dfa8a74b13 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:45.462310 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d7a6f58-1ec9-4587-9796-04dfa8a74b13 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:45.463004 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d7a6f58-1ec9-4587-9796-04dfa8a74b13 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:45.463715 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d7a6f58-1ec9-4587-9796-04dfa8a74b13 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:45.464174 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d7a6f58-1ec9-4587-9796-04dfa8a74b13 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:45.464600 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-8d7a6f58-1ec9-4587-9796-04dfa8a74b13 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:45.467615 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-a1eaadd6-0264-4b42-871f-2fc9d5739c4d req-25c97d86-83d2-43fd-a4f6-bc2e3f12fdd4 service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:45.468210 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-a1eaadd6-0264-4b42-871f-2fc9d5739c4d req-25c97d86-83d2-43fd-a4f6-bc2e3f12fdd4 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:45.468869 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-a1eaadd6-0264-4b42-871f-2fc9d5739c4d req-25c97d86-83d2-43fd-a4f6-bc2e3f12fdd4 service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:45.486947 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-a1eaadd6-0264-4b42-871f-2fc9d5739c4d req-25c97d86-83d2-43fd-a4f6-bc2e3f12fdd4 service nova] Creating event network-changed:783bedf3-9fb9-4027-bf33-a7a0ccbdc941 for instance 75316fb8-2a0f-4676-8896-d90ca8e9419c on hv-cinder-85032 Sep 09 23:35:45.487788 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-a1eaadd6-0264-4b42-871f-2fc9d5739c4d req-25c97d86-83d2-43fd-a4f6-bc2e3f12fdd4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035983 Sep 09 23:35:45.488583 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 562/1156] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:35:45.495798 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-8d7a6f58-1ec9-4587-9796-04dfa8a74b13 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Going to try to terminate instance {{(pid=121059) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 23:35:45.767403 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-8d7a6f58-1ec9-4587-9796-04dfa8a74b13 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "DELETE /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 204 len: 0 microversion: 2.1 time: 0.317621 Sep 09 23:35:45.768651 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 595/1157] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:35:45 2022] DELETE /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 23:35:45.778469 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-ea737fde-5243-4900-996d-1115647d2a85 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:35:45.779513 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-ea737fde-5243-4900-996d-1115647d2a85 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:35:45.785962 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ea737fde-5243-4900-996d-1115647d2a85 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:45.786705 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ea737fde-5243-4900-996d-1115647d2a85 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:45.787148 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ea737fde-5243-4900-996d-1115647d2a85 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:45.788716 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ea737fde-5243-4900-996d-1115647d2a85 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:45.789367 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ea737fde-5243-4900-996d-1115647d2a85 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:45.789978 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-ea737fde-5243-4900-996d-1115647d2a85 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:45.929457 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.policy [None req-ea737fde-5243-4900-996d-1115647d2a85 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121058) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:35:45.937358 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-ea737fde-5243-4900-996d-1115647d2a85 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1580 microversion: 2.1 time: 0.163112 Sep 09 23:35:45.937913 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 563/1158] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:35:45 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1580 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:35:46.961481 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-ac1af02a-61fa-47f6-ad4f-5801a72082ad tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:35:46.962230 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-ac1af02a-61fa-47f6-ad4f-5801a72082ad tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:35:46.968723 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ac1af02a-61fa-47f6-ad4f-5801a72082ad tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:46.969215 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ac1af02a-61fa-47f6-ad4f-5801a72082ad tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:46.969654 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ac1af02a-61fa-47f6-ad4f-5801a72082ad tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:46.970361 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ac1af02a-61fa-47f6-ad4f-5801a72082ad tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:46.970818 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ac1af02a-61fa-47f6-ad4f-5801a72082ad tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:46.971247 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-ac1af02a-61fa-47f6-ad4f-5801a72082ad tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:47.106137 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-ac1af02a-61fa-47f6-ad4f-5801a72082ad tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:35:47.114043 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-ac1af02a-61fa-47f6-ad4f-5801a72082ad tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1580 microversion: 2.1 time: 0.156835 Sep 09 23:35:47.114659 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 596/1159] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:35:46 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1580 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:35:47.989886 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [req-4f0ab794-9d13-428c-9f27-57e09ffa08f4 req-4f6c0c90-63eb-4a48-b9bc-cabbe2b51bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75316fb8-2a0f-4676-8896-d90ca8e9419c", "name": "network-vif-deleted", "tag": "783bedf3-9fb9-4027-bf33-a7a0ccbdc941"}]} {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 23:35:48.000499 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-4f0ab794-9d13-428c-9f27-57e09ffa08f4 req-4f6c0c90-63eb-4a48-b9bc-cabbe2b51bcb service nova] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:48.001452 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-4f0ab794-9d13-428c-9f27-57e09ffa08f4 req-4f6c0c90-63eb-4a48-b9bc-cabbe2b51bcb service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:48.001452 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [req-4f0ab794-9d13-428c-9f27-57e09ffa08f4 req-4f6c0c90-63eb-4a48-b9bc-cabbe2b51bcb service nova] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:48.012557 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.compute.server_external_events [req-4f0ab794-9d13-428c-9f27-57e09ffa08f4 req-4f6c0c90-63eb-4a48-b9bc-cabbe2b51bcb service nova] Creating event network-vif-deleted:783bedf3-9fb9-4027-bf33-a7a0ccbdc941 for instance 75316fb8-2a0f-4676-8896-d90ca8e9419c on hv-cinder-85032 Sep 09 23:35:48.017413 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [req-4f0ab794-9d13-428c-9f27-57e09ffa08f4 req-4f6c0c90-63eb-4a48-b9bc-cabbe2b51bcb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031242 Sep 09 23:35:48.017997 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 564/1160] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 23:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 23:35:48.138246 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-4413d4aa-00c5-46b3-8ff1-41c68bead8fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:35:48.138895 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-4413d4aa-00c5-46b3-8ff1-41c68bead8fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:35:48.145821 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4413d4aa-00c5-46b3-8ff1-41c68bead8fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:48.146313 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4413d4aa-00c5-46b3-8ff1-41c68bead8fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:48.147287 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4413d4aa-00c5-46b3-8ff1-41c68bead8fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:48.148076 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4413d4aa-00c5-46b3-8ff1-41c68bead8fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:48.148492 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4413d4aa-00c5-46b3-8ff1-41c68bead8fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:48.149072 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-4413d4aa-00c5-46b3-8ff1-41c68bead8fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:48.220825 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.policy [None req-4413d4aa-00c5-46b3-8ff1-41c68bead8fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c81c0af6f084b8db165fd51667b3b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8042eb99cd7047d4912b2f4b1e50936e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121059) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 23:35:48.225940 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-4413d4aa-00c5-46b3-8ff1-41c68bead8fd tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 200 len: 1226 microversion: 2.1 time: 0.091697 Sep 09 23:35:48.227144 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 597/1161] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:35:48 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 23:35:49.250690 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c7cc3bae-c6bd-4b19-9d65-5d5c8a8410c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:35:49.251298 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-c7cc3bae-c6bd-4b19-9d65-5d5c8a8410c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 75316fb8-2a0f-4676-8896-d90ca8e9419c] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:35:49.258005 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c7cc3bae-c6bd-4b19-9d65-5d5c8a8410c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:49.258617 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c7cc3bae-c6bd-4b19-9d65-5d5c8a8410c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:49.259055 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c7cc3bae-c6bd-4b19-9d65-5d5c8a8410c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:49.259752 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c7cc3bae-c6bd-4b19-9d65-5d5c8a8410c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:49.260202 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c7cc3bae-c6bd-4b19-9d65-5d5c8a8410c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:49.260625 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-c7cc3bae-c6bd-4b19-9d65-5d5c8a8410c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:49.274549 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-c7cc3bae-c6bd-4b19-9d65-5d5c8a8410c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] HTTP exception thrown: Instance 75316fb8-2a0f-4676-8896-d90ca8e9419c could not be found. Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c7cc3bae-c6bd-4b19-9d65-5d5c8a8410c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Request method failure captured: Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c HTTP/1.1 Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8w1jhDZJe0FlEHFn-Uk3JIz2iO-zQw8kgYSPCECy1gvaKWNHHmi9qfeJ8dL8KBR9xLyhJjx-YPB-onU_SL1WA92vQmhaLX903PFXCOXoS2_ZUvYsLbR1xcv8oIkbHwphE3Ud0RfReWw4dVzeF0H1d6p_HOwpobgoO5WYl8Baq9M0nM Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 8042eb99cd7047d4912b2f4b1e50936e Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-TestVolumeBootPattern-318475639 Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:35:49.276182 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:35:49.277917 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8042eb99cd7047d4912b2f4b1e50936e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8042eb99cd7047d4912b2f4b1e50936e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8042eb99cd7047d4912b2f4b1e50936e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8042eb99cd7047d4912b2f4b1e50936e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:35:49.277917 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-TestVolumeBootPattern-318475639 Sep 09 23:35:49.277917 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 8042eb99cd7047d4912b2f4b1e50936e Sep 09 23:35:49.277917 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-TestVolumeBootPattern-318475639 Sep 09 23:35:49.277917 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-TestVolumeBootPattern-318475639-project Sep 09 23:35:49.277917 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:35:49.277917 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:35:49.277917 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 8c81c0af6f084b8db165fd51667b3b54 Sep 09 23:35:49.277917 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-TestVolumeBootPattern-318475639-project Sep 09 23:35:49.277917 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:35:49.277917 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 75316fb8-2a0f-4676-8896-d90ca8e9419c could not be found. Sep 09 23:35:49.277917 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '75316fb8-2a0f-4676-8896-d90ca8e9419c'} Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75316fb8-2a0f-4676-8896-d90ca8e9419c could not be found. Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:35:49.278862 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75316fb8-2a0f-4676-8896-d90ca8e9419c could not be found. Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75316fb8-2a0f-4676-8896-d90ca8e9419c could not be found. Sep 09 23:35:49.280497 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:35:49.281941 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-c7cc3bae-c6bd-4b19-9d65-5d5c8a8410c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Returning 404 to user: Instance 75316fb8-2a0f-4676-8896-d90ca8e9419c could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:35:49.281941 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-c7cc3bae-c6bd-4b19-9d65-5d5c8a8410c9 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c" status: 404 len: 111 microversion: 2.1 time: 0.031876 Sep 09 23:35:49.281941 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 565/1162] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:35:49 2022] GET /compute/v2.1/servers/75316fb8-2a0f-4676-8896-d90ca8e9419c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:35:49.787434 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-386d9da5-55b3-4ad1-a97f-2282b741b650 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:35:49.787953 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.compute.api [None req-386d9da5-55b3-4ad1-a97f-2282b741b650 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121059) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:35:49.794939 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-386d9da5-55b3-4ad1-a97f-2282b741b650 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:49.795420 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-386d9da5-55b3-4ad1-a97f-2282b741b650 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:49.795856 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-386d9da5-55b3-4ad1-a97f-2282b741b650 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:49.796543 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-386d9da5-55b3-4ad1-a97f-2282b741b650 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:49.796994 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-386d9da5-55b3-4ad1-a97f-2282b741b650 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:49.797417 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG oslo_concurrency.lockutils [None req-386d9da5-55b3-4ad1-a97f-2282b741b650 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:49.811212 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.wsgi [None req-386d9da5-55b3-4ad1-a97f-2282b741b650 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] HTTP exception thrown: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-386d9da5-55b3-4ad1-a97f-2282b741b650 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Request method failure captured: Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: request: DELETE /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 HTTP/1.1 Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept: application/json Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Accept-Encoding: identity Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Connection: close Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Length: 0 Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Content-Type: application/json Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Host: 10.222.0.20 Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: Openstack-System-Scope: None Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: User-Agent: python-urllib3/1.26.12 Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Auth-Token: gAAAAABjG8w1jhDZJe0FlEHFn-Uk3JIz2iO-zQw8kgYSPCECy1gvaKWNHHmi9qfeJ8dL8KBR9xLyhJjx-YPB-onU_SL1WA92vQmhaLX903PFXCOXoS2_ZUvYsLbR1xcv8oIkbHwphE3Ud0RfReWw4dVzeF0H1d6p_HOwpobgoO5WYl8Baq9M0nM Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Id: None Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Domain-Name: None Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Identity-Status: Confirmed Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Is-Admin-Project: True Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Id: default Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Domain-Name: Default Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Id: 8042eb99cd7047d4912b2f4b1e50936e Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Project-Name: tempest-TestVolumeBootPattern-318475639 Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Role: reader,member Sep 09 23:35:49.812874 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Roles: reader,member Sep 09 23:35:49.817359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8042eb99cd7047d4912b2f4b1e50936e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8042eb99cd7047d4912b2f4b1e50936e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8042eb99cd7047d4912b2f4b1e50936e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8042eb99cd7047d4912b2f4b1e50936e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:35:49.817359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant: tempest-TestVolumeBootPattern-318475639 Sep 09 23:35:49.817359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Id: 8042eb99cd7047d4912b2f4b1e50936e Sep 09 23:35:49.817359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-Tenant-Name: tempest-TestVolumeBootPattern-318475639 Sep 09 23:35:49.817359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User: tempest-TestVolumeBootPattern-318475639-project Sep 09 23:35:49.817359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Id: default Sep 09 23:35:49.817359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Domain-Name: Default Sep 09 23:35:49.817359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Id: 8c81c0af6f084b8db165fd51667b3b54 Sep 09 23:35:49.817359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: X-User-Name: tempest-TestVolumeBootPattern-318475639-project Sep 09 23:35:49.817359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: method: > Sep 09 23:35:49.817359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: exception: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. Sep 09 23:35:49.817359 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: action_args: {'id': '47f980e0-fd89-4da8-a658-577721144b73'} Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:35:49.818333 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. Sep 09 23:35:49.820638 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: ERROR nova.api.openstack.wsgi Sep 09 23:35:49.822584 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-386d9da5-55b3-4ad1-a97f-2282b741b650 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Returning 404 to user: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. {{(pid=121059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:35:49.822584 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-386d9da5-55b3-4ad1-a97f-2282b741b650 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "DELETE /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 404 len: 111 microversion: 2.1 time: 0.030705 Sep 09 23:35:49.822584 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 598/1163] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 23:35:49 2022] DELETE /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 23:35:49.824520 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-22d74dbf-8883-4f21-8ac7-c31c3d046141 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '>' {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:35:49.825146 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.compute.api [None req-22d74dbf-8883-4f21-8ac7-c31c3d046141 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] [instance: 47f980e0-fd89-4da8-a658-577721144b73] Fetching instance by UUID {{(pid=121058) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 23:35:49.831137 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-22d74dbf-8883-4f21-8ac7-c31c3d046141 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:49.831620 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-22d74dbf-8883-4f21-8ac7-c31c3d046141 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:49.832060 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-22d74dbf-8883-4f21-8ac7-c31c3d046141 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:49.832768 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-22d74dbf-8883-4f21-8ac7-c31c3d046141 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Acquiring lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 23:35:49.833209 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-22d74dbf-8883-4f21-8ac7-c31c3d046141 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 23:35:49.833640 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG oslo_concurrency.lockutils [None req-22d74dbf-8883-4f21-8ac7-c31c3d046141 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Lock "3b9492f5-2bb0-48cb-8579-ad5c4a6d5d4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 23:35:49.846923 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.wsgi [None req-22d74dbf-8883-4f21-8ac7-c31c3d046141 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] HTTP exception thrown: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-22d74dbf-8883-4f21-8ac7-c31c3d046141 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Request method failure captured: Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: request: GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 HTTP/1.1 Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept: application/json Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Accept-Encoding: identity Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Connection: close Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Length: 0 Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Content-Type: application/json Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Host: 10.222.0.20 Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: Openstack-System-Scope: None Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: User-Agent: python-urllib3/1.26.12 Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Auth-Token: gAAAAABjG8w1jhDZJe0FlEHFn-Uk3JIz2iO-zQw8kgYSPCECy1gvaKWNHHmi9qfeJ8dL8KBR9xLyhJjx-YPB-onU_SL1WA92vQmhaLX903PFXCOXoS2_ZUvYsLbR1xcv8oIkbHwphE3Ud0RfReWw4dVzeF0H1d6p_HOwpobgoO5WYl8Baq9M0nM Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Id: None Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Domain-Name: None Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Identity-Status: Confirmed Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Is-Admin-Project: True Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Id: default Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Domain-Name: Default Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Id: 8042eb99cd7047d4912b2f4b1e50936e Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Project-Name: tempest-TestVolumeBootPattern-318475639 Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Role: reader,member Sep 09 23:35:49.848437 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Roles: reader,member Sep 09 23:35:49.850268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8042eb99cd7047d4912b2f4b1e50936e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8042eb99cd7047d4912b2f4b1e50936e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8042eb99cd7047d4912b2f4b1e50936e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8042eb99cd7047d4912b2f4b1e50936e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 09 23:35:49.850268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant: tempest-TestVolumeBootPattern-318475639 Sep 09 23:35:49.850268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Id: 8042eb99cd7047d4912b2f4b1e50936e Sep 09 23:35:49.850268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-Tenant-Name: tempest-TestVolumeBootPattern-318475639 Sep 09 23:35:49.850268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User: tempest-TestVolumeBootPattern-318475639-project Sep 09 23:35:49.850268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Id: default Sep 09 23:35:49.850268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Domain-Name: Default Sep 09 23:35:49.850268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Id: 8c81c0af6f084b8db165fd51667b3b54 Sep 09 23:35:49.850268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: X-User-Name: tempest-TestVolumeBootPattern-318475639-project Sep 09 23:35:49.850268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: method: > Sep 09 23:35:49.850268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: exception: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. Sep 09 23:35:49.850268 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: action_args: {'id': '47f980e0-fd89-4da8-a658-577721144b73'} Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: {{(pid=121058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 23:35:49.854599 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. Sep 09 23:35:49.856317 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: ERROR nova.api.openstack.wsgi Sep 09 23:35:49.858301 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: DEBUG nova.api.openstack.wsgi [None req-22d74dbf-8883-4f21-8ac7-c31c3d046141 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Returning 404 to user: Instance 47f980e0-fd89-4da8-a658-577721144b73 could not be found. {{(pid=121058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 23:35:49.858301 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: INFO nova.api.openstack.requestlog [None req-22d74dbf-8883-4f21-8ac7-c31c3d046141 tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73" status: 404 len: 111 microversion: 2.1 time: 0.029878 Sep 09 23:35:49.858301 dv-cinder-850321-6-iscsi devstack@n-api.service[121058]: [pid: 121058|app: 0|req: 566/1164] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 23:35:49 2022] GET /compute/v2.1/servers/47f980e0-fd89-4da8-a658-577721144b73 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 23:35:51.298009 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: DEBUG nova.api.openstack.wsgi [None req-04448a2d-f080-49b7-989f-73358ba654dc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] Calling method '.version_select at 0x7f908dd9b4c0>' {{(pid=121059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 23:35:51.390272 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: INFO nova.api.openstack.requestlog [None req-04448a2d-f080-49b7-989f-73358ba654dc tempest-TestVolumeBootPattern-318475639 tempest-TestVolumeBootPattern-318475639-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1647096225" status: 202 len: 0 microversion: 2.1 time: 0.095956 Sep 09 23:35:51.390883 dv-cinder-850321-6-iscsi devstack@n-api.service[121059]: [pid: 121059|app: 0|req: 599/1165] 10.222.0.20 () {58 vars in 1263 bytes} [Fri Sep 9 23:35:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1647096225 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)